-- Logs begin at Thu 2021-12-09 00:29:41 UTC, end at Thu 2021-12-09 01:28:19 UTC. -- Dec 09 00:55:29.155166 dv-cinder-790535-20-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 9 00:55:29 2021] *** Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: nodename: dv-cinder-790535-20-iscsi Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: machine: x86_64 Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: clock source: unix Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: pcre jit disabled Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: detected number of CPU cores: 4 Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: current working directory: / Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: detected binary path: /usr/bin/uwsgi-core Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: your processes number limit is 47680 Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: your memory page size is 4096 bytes Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: detected max file descriptor number: 2048 Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: lock engine: pthread robust mutexes Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: thunder lock: enabled Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 09 00:55:29.166388 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 09 00:55:29.210386 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: Python main interpreter initialized at 0x561051d259c0 Dec 09 00:55:29.210386 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: python threads support enabled Dec 09 00:55:29.210386 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: your server socket listen backlog is limited to 100 connections Dec 09 00:55:29.210386 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: your mercy for graceful operations on workers is 90 seconds Dec 09 00:55:29.210767 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: mapped 403077 bytes (393 KB) for 2 cores Dec 09 00:55:29.210851 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: *** Operational MODE: preforking *** Dec 09 00:55:29.211091 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: *** uWSGI is running in multiple interpreter mode *** Dec 09 00:55:29.211091 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: spawned uWSGI master process (pid: 79316) Dec 09 00:55:29.211299 dv-cinder-790535-20-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 09 00:55:29.214403 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: spawned uWSGI worker 1 (pid: 79330, cores: 1) Dec 09 00:55:29.214403 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: spawned uWSGI worker 2 (pid: 79331, cores: 1) Dec 09 00:55:29.214403 dv-cinder-790535-20-iscsi devstack@keystone.service[79316]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 09 00:55:34.547642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 00:55:34.547642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: from cryptography.utils import int_from_bytes Dec 09 00:55:34.548436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 00:55:34.548436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: from cryptography.utils import int_from_bytes Dec 09 00:55:34.555259 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 00:55:34.555259 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: from cryptography.utils import int_from_bytes Dec 09 00:55:34.555723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 00:55:34.555723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: from cryptography.utils import int_from_bytes Dec 09 00:55:34.597728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 09 00:55:34.597910 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 09 00:55:34.598130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] command line args: [] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 09 00:55:34.598585 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 09 00:55:34.598766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ================================================================================ {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 09 00:55:34.599030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] admin_token = **** {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.599276 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] config_dir = [] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.599460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.599639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] config_source = [] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.599817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] debug = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.600020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.601396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.601396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.601396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.601396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.601396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] list_limit = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.601396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] log_config_append = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.601837 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.601837 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] log_dir = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.601975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] log_file = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.602121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.602389 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.602638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.602885 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.603018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 09 00:55:34.603103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.603182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 09 00:55:34.603300 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.603382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] command line args: [] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 09 00:55:34.603455 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.603578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 09 00:55:34.603687 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.603773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ================================================================================ {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 09 00:55:34.603918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.604037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] admin_token = **** {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.604140 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.604214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] config_dir = [] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.604362 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.604447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.604548 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] config_source = [] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.604632 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.604715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] debug = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.604823 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.604935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.605067 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.605174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.605337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.605423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.605598 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.605819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.605902 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.606065 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] publish_errors = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.606152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] list_limit = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.606229 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.606345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] log_config_append = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.606454 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.606527 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.606605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] log_dir = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.606678 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.606747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] log_file = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.606861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.606974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.607059 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.607224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.607302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] standard_threads = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.607471 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.607551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.607718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.607809 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.607881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.607955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.608056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] use_journal = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.608131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.608247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] use_json = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.608326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.608399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] use_stderr = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.608531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.608609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] use_syslog = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.608765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.608848 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.608998 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.609152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.609274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.609352 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.609455 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.609539 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.609701 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.609784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.609947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.610030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.610182 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.610266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.610458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.610697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.610776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.610900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] publish_errors = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.610984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.611140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.611217 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.611375 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.611460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.611559 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.611638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.611811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.611896 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.612050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.612180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.612286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] standard_threads = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.612365 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.612520 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.612598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.612766 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.612921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.612997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.613572 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.613827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] use_journal = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.613996 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.614176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] use_json = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.614320 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.614489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] use_stderr = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.614676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] use_syslog = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.614763 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.614921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 00:55:34.615006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.615185 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.615268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.615429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.615511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.615688 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.615770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.615923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.616014 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.616154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.616238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.616387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.616465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.616624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.616702 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.616873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.616957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.617119 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.617197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.617351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.617429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.617580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.617672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.617825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.617903 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.618074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.618153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.618309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.618408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.618582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.618668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.618814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.618899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.619049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.619128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.619283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.619434 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.619510 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.619579 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.619728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.619806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.619956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.620041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.620184 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.620262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.620420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.620508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.620667 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.620756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.620896 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.620974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.621132 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.621216 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.621360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.621446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.621595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.621672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.621829 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.621913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.622073 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.622159 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.622302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.622398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.622572 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.622651 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.622807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.622897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.623050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.623126 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.623287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.623391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.623524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.623636 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.623738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.623840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.624024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.624171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.624304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.624413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.624495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.624568 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.624690 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.624774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.624884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.625011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.625118 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.625197 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.625349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.625433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.625585 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.625672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.625820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.625948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.626051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.626135 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.626289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.626442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.626578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.626657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.626773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.626895 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.627030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.627149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.627269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.627349 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.627506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.627591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.627742 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.627821 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.627983 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.628064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.628219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.628301 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.628455 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.628534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.628757 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.629492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.629586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.629759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.629838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.630092 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.630177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.630452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.630611 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.630726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.630896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.630974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.631141 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.631221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.631410 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.631495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.631645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.631729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.631879 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.631954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.632124 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.632257 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.632363 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.632444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.632625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.632712 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.632868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.632950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.633100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] auth.external = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.633187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.633328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.633406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.633610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.633686 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.633839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.633923 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.634071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] auth.password = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.634150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.634298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] auth.token = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.634407 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.634564 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.634655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.634798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.634884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.635041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.635117 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.635268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.635345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.635513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.635598 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.635758 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.635843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.635989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.636072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.636223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.636306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] credential.caching = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.636459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.636538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.636699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.636776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.636935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.637023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.637170 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.637247 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.637407 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.637483 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.637641 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.637724 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.637885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.637968 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.638135 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.638212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.638381 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.638472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.638646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.638729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.638880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] auth.external = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.638987 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.639117 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.639202 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.639426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.639521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.639645 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.639724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.639879 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] auth.password = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.639965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.640114 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] auth.token = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.640203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] federation.caching = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.640356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.640435 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.640596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.640685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.640842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.640927 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.641075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.641152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.641327 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.641577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.641653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.641811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.641890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.642051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] credential.caching = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.642130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.642286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.642391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.642565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.642644 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.642802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.642880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.643044 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.643121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.643280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.caching = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.643358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.643521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.643598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.643766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.643844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.644004 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.644119 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.644241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.644333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.644586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.644665 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.644910 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.645116 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.645301 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.645559 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.645637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.645822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.645946 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.646059 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.646204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.646289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.646498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.646669 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.646747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] federation.caching = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.646819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.646993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.647072 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.647248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.647334 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.647501 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.647579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.647740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.647818 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.647995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.648081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.648236 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.648322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.648475 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.648553 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.648710 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.648807 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.648946 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.649024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.649177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.649255 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.649415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.649502 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.649656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.649740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.caching = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.649893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.649971 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.650140 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.650226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.650385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.650477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.650629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.650706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.650873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.650958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.651104 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.651181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.651345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.651423 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.651589 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.651676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.651821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.651905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.652058 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.652136 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.652289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.652374 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.652522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.652599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.652755 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.652832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.652995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.653081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.653233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.653317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.653476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.653561 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.653709 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.653796 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.653956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.654034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.654185 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.654262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.654445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.654541 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.654684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.654761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.654925 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.655003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.655158 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.655243 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.655395 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.655474 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.655630 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.655707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.655860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.655954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.656100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.656178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.656330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.656408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.656572 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.656650 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.656818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.656895 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.657056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.657135 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.657299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.657377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.657534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.657612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.657767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.657844 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.658000 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.658078 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.658230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.658307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.658493 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.658573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.658727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.658806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.658968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.659045 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.659210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.659287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.659449 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.659529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.659692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.659770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.660534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.660625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.660927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.661007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.661180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.661313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.661421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.661574 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.661660 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.661842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.661946 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.662073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.662157 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.662316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.662423 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.662584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.662664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.662821 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.662900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.663065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.663152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.663295 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.663372 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.663540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.663618 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.663776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.663866 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.664013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.664092 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.664249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.664328 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.664491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.664576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.664727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.664805 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.664956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.665034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.665192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.665277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.665429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.665506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] resource.caching = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.665673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.665751 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.665915 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.666001 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.666151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.666230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.666422 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.666506 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.666673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.666762 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.666907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.666985 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.667152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.667230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.667387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.667474 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.667627 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.667705 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.667862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] role.caching = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.667947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.668108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] role.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.668194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.668341 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.668420 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.668588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.668665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.668832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.668918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.669070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.669148 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.669313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.669392 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.669545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.669630 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.669793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.669871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.670033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.670111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.670270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.670444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.670522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.670594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.670773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.670852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.671017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.671097 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.671251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.671330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.671489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.671567 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.671730 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] resource.caching = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.671898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.671977 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.672134 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.672212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.672383 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.672469 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.672632 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.672711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.672880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.672958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.673129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.673215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.673364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.673443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.673616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.673694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.673858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.673942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.674094 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.674171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] role.caching = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.674325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.674456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] role.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.674582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.674673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.674815 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.674893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.675064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.675142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.675313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.675398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.675578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.675715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.675827 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.675974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.676069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.676283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.676445 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.676524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] token.caching = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.676721 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.676800 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.676975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.677060 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.677213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.677289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.677466 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.677543 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.677715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.677801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.677951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.678029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.678194 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.678272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.678469 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.678613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.678718 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.678856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.678954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.679110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.679201 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.679364 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.679443 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.679617 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.679695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.679872 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.679958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.680099 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.680176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.680341 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.680419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.680595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.680679 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.680839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.680924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.connection = **** {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.681073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.681151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.681308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.681393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.681544 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.681622 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.681781 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.681858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.682017 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.682103 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.682254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.682333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.682511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.682591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.682746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.682836 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.682983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.683062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.683224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] token.caching = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.683303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.683468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.683554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.683703 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.683794 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.683943 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.684019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.684176 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.684253 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.684420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.684500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.684650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.684727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.684888 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.684966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.685124 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.685210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.685284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 09 00:55:34.685355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.685596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.685836 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.686072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.686320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.686593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.686826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.687074 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.687338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.687610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.connection = **** {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.687858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.688106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.688346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.688589 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.688830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.689072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.689312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.689551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.689829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.690071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.690318 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.690582 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.690836 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.691075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.691873 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.692322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.692606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.692851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 00:55:34.693026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 09 00:55:34.715562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.715794 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.716023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.718348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.718612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.718842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.725871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.729285 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.754947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.755180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.756643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.756879 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.807303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.807997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.858923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.859168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.859653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.859895 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.925370 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.925544 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.925665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.925919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.926065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.926151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.926348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.926453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.926592 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.926675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.926881 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.927104 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.950246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.950503 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.950592 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.950733 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.950817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.950956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.951041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.951175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.951258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.951394 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.951486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.951609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.951746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.951963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.963092 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.963406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.976334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.976584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.976820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.976905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.977041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.977141 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.977256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.977339 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.977469 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.977552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.977681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.977765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.977954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.978171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 09 00:55:34.995863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:34.996073 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 09 00:55:34.996407 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:34.996603 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 09 00:55:34.996868 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:34.997123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:34.997215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:34.997381 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:34.997464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 09 00:55:34.997633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:34.997715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:34.997921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 09 00:55:34.998195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:34.998487 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:34.998749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:34.999005 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.008640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.008913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.009450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.009734 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.010350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.010652 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.010922 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.011202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.019276 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.019505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.022844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.022930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.023127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.023222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.023411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.023492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.023693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.023775 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.023972 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.024053 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.024228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.024308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.024494 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.024584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.024764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.024855 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.025029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.025111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.025296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.025385 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.025560 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.025639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.052383 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.052641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.053963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.054210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.054295 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.054512 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.059691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.059790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.059930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.060042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.060208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.060325 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.067681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.067788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.067961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.068044 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.072331 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.072415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.072620 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.072703 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.072898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.072980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.073177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.073268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.073446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.073527 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.073714 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.073796 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.073979 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.074101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.074244 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.074519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.093178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.093363 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.093469 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.093642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.097948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.098554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.101782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.102073 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.102161 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.102541 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.106962 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.107456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.110464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.110974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.114548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.114843 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.115126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.115361 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.115443 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.115658 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.115739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.115943 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.116032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.116238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.116525 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.116824 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.134566 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.134844 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.135110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.135373 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.135977 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.136262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.136532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.136799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.143009 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.145078 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.145396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.145731 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.146961 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.147237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.148947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.149224 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.149502 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.149788 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.150071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.150326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.150631 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.150912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.151195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.151472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.163257 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.163542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.163822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.164102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.164390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.164664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.164950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.165030 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.165256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.165535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.165814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.166189 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.166499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.166791 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.182936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.185000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.186277 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.188241 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.189653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.191396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.191812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.192973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.193260 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.193551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.193645 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.195167 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.195448 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.195728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.200684 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.202237 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.202857 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.204417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.205512 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.205798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.206080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.206374 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.208329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.208617 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.209006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.209286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.215881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.216167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.216444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.218189 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.218510 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.218793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.224380 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.224655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.224949 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.225206 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.225472 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.225749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.226030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.226307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.226605 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.226878 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.227070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 09 00:55:35.227153 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.227359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.227439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.227641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.227721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.227910 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.227989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.228178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.228554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.228830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.229105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.229395 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.229672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.229942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.230209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.230570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.230842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 09 00:55:35.265392 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561051d259c0 pid: 79330 (default app) Dec 09 00:55:35.270248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a4f90-6c1c-44bd-bb90-ec7b3e4880a0 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:35.270560 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a4f90-6c1c-44bd-bb90-ec7b3e4880a0 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:35.270816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561051d259c0 pid: 79331 (default app) Dec 09 00:55:35.270899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a4f90-6c1c-44bd-bb90-ec7b3e4880a0 None None] PATH_INFO: `/v3` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:35.275014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Thu Dec 9 00:55:35 2021] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:55:43.141756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b8d67-abcf-4e7a-8daa-772f511dcd1e None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:43.142260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b8d67-abcf-4e7a-8daa-772f511dcd1e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:43.142260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b8d67-abcf-4e7a-8daa-772f511dcd1e None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:43.148477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:43 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:55:43.154461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cf7d-55bf-471c-80c7-231e06c73960 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:43.154866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cf7d-55bf-471c-80c7-231e06c73960 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:43.155012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cf7d-55bf-471c-80c7-231e06c73960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:43.185651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG oslo_db.sqlalchemy.engines [None req-7589cf7d-55bf-471c-80c7-231e06c73960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 00:55:43.372967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG passlib.handlers.bcrypt [None req-7589cf7d-55bf-471c-80c7-231e06c73960 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79330) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 09 00:55:43.373378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG passlib.handlers.bcrypt [None req-7589cf7d-55bf-471c-80c7-231e06c73960 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79330) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 09 00:55:43.430432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-7589cf7d-55bf-471c-80c7-231e06c73960 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:43.432399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7589cf7d-55bf-471c-80c7-231e06c73960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:43.564425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:55:43.599739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b8d67-abcf-4e7a-8daa-772f511dcd1e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:43.632971 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG oslo_db.sqlalchemy.engines [None req-b00b8d67-abcf-4e7a-8daa-772f511dcd1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 00:55:43.764043 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b8d67-abcf-4e7a-8daa-772f511dcd1e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:43.768201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73211f1-f2cf-4c45-86e2-d48e717fc64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:43.768862 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73211f1-f2cf-4c45-86e2-d48e717fc64d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:43.769816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73211f1-f2cf-4c45-86e2-d48e717fc64d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:43.770296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73211f1-f2cf-4c45-86e2-d48e717fc64d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:43.777849 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73211f1-f2cf-4c45-86e2-d48e717fc64d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:43.828829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c73211f1-f2cf-4c45-86e2-d48e717fc64d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 09 00:55:43.829170 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73211f1-f2cf-4c45-86e2-d48e717fc64d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:43.838908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:55:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:55:43.845475 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589cf7d-55bf-471c-80c7-231e06c73960 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:43.859728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589cf7d-55bf-471c-80c7-231e06c73960 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:43.864437 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d568de-1c9b-4989-9a36-cb3bbb969d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:43.865533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d568de-1c9b-4989-9a36-cb3bbb969d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:43.865814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d568de-1c9b-4989-9a36-cb3bbb969d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:43.866086 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d568de-1c9b-4989-9a36-cb3bbb969d0f admin admin] PATH_INFO: `/v3/projects/190e540339684142b1a25d3f47e2a0ee` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:43.867626 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d568de-1c9b-4989-9a36-cb3bbb969d0f admin admin] RBAC: Authorizing `identity:get_project(project_id=190e540339684142b1a25d3f47e2a0ee)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:43.917437 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c8d568de-1c9b-4989-9a36-cb3bbb969d0f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 09 00:55:43.917773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d568de-1c9b-4989-9a36-cb3bbb969d0f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:43.922338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:55:43 2021] GET /identity/v3/projects/190e540339684142b1a25d3f47e2a0ee => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:55:46.314162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf63ca-0f1c-4a77-9cac-dadf0aa2c91f None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:46.314714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf63ca-0f1c-4a77-9cac-dadf0aa2c91f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:46.314804 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf63ca-0f1c-4a77-9cac-dadf0aa2c91f None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:46.319777 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:46 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:55:46.325649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edae3f-5cb2-4e08-9f47-50610ac30d8b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:46.326030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edae3f-5cb2-4e08-9f47-50610ac30d8b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:46.326217 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edae3f-5cb2-4e08-9f47-50610ac30d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:46.345186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-68edae3f-5cb2-4e08-9f47-50610ac30d8b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:46.346750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-68edae3f-5cb2-4e08-9f47-50610ac30d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:46.355337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:55:46.379130 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf63ca-0f1c-4a77-9cac-dadf0aa2c91f None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:46.391250 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf63ca-0f1c-4a77-9cac-dadf0aa2c91f None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:46.396416 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe822d6-3107-48f0-bd8b-71b43b4f1646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:46.397041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe822d6-3107-48f0-bd8b-71b43b4f1646 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:46.397328 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe822d6-3107-48f0-bd8b-71b43b4f1646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:46.397608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe822d6-3107-48f0-bd8b-71b43b4f1646 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:46.406093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe822d6-3107-48f0-bd8b-71b43b4f1646 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:46.407936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe822d6-3107-48f0-bd8b-71b43b4f1646 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:46.419194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:55:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:55:46.425410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edae3f-5cb2-4e08-9f47-50610ac30d8b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:46.434856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edae3f-5cb2-4e08-9f47-50610ac30d8b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:46.439295 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274ac36-a88a-4c84-acfc-3cb1dd9d0716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:46.440154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ac36-a88a-4c84-acfc-3cb1dd9d0716 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:46.440434 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ac36-a88a-4c84-acfc-3cb1dd9d0716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:46.440708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ac36-a88a-4c84-acfc-3cb1dd9d0716 admin admin] PATH_INFO: `/v3/users/9a491d369dd94708903d971f130743aa` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:46.442119 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274ac36-a88a-4c84-acfc-3cb1dd9d0716 admin admin] RBAC: Authorizing `identity:get_user(user_id=9a491d369dd94708903d971f130743aa)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:46.443989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274ac36-a88a-4c84-acfc-3cb1dd9d0716 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:46.445543 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:55:46 2021] GET /identity/v3/users/9a491d369dd94708903d971f130743aa => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:55:48.859467 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e5658-c2cc-4cca-9fe3-4d97e8bdec8a None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:48.859932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e5658-c2cc-4cca-9fe3-4d97e8bdec8a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:48.860018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e5658-c2cc-4cca-9fe3-4d97e8bdec8a None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:48.861738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:55:48.867735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d72871-1865-4bd9-a748-80a1fcc98057 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:48.868231 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d72871-1865-4bd9-a748-80a1fcc98057 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:48.868427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d72871-1865-4bd9-a748-80a1fcc98057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:48.887261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-05d72871-1865-4bd9-a748-80a1fcc98057 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:48.888455 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-05d72871-1865-4bd9-a748-80a1fcc98057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:48.893139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80afe2-d48f-43b6-bd76-b1839cf6fa4d None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:48.893425 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80afe2-d48f-43b6-bd76-b1839cf6fa4d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:48.893703 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80afe2-d48f-43b6-bd76-b1839cf6fa4d None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:48.895937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:55:48.896738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:55:48.901377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7dfda-6ead-4ac3-b54b-26e3af7fb52c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:48.901663 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7dfda-6ead-4ac3-b54b-26e3af7fb52c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:48.901938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7dfda-6ead-4ac3-b54b-26e3af7fb52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:48.921218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d72871-1865-4bd9-a748-80a1fcc98057 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:48.930328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d72871-1865-4bd9-a748-80a1fcc98057 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:48.934776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df59e3-18d8-4a27-9ff5-d007c99d3e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:48.935561 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df59e3-18d8-4a27-9ff5-d007c99d3e2e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:48.935848 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df59e3-18d8-4a27-9ff5-d007c99d3e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:48.936126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df59e3-18d8-4a27-9ff5-d007c99d3e2e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:48.942737 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG passlib.handlers.bcrypt [None req-cfb7dfda-6ead-4ac3-b54b-26e3af7fb52c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79331) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 09 00:55:48.943163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG passlib.handlers.bcrypt [None req-cfb7dfda-6ead-4ac3-b54b-26e3af7fb52c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79331) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 09 00:55:48.990608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-cfb7dfda-6ead-4ac3-b54b-26e3af7fb52c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:48.992240 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cfb7dfda-6ead-4ac3-b54b-26e3af7fb52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:49.016339 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:55:49.039677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7dfda-6ead-4ac3-b54b-26e3af7fb52c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:49.049067 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7dfda-6ead-4ac3-b54b-26e3af7fb52c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:49.052907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df59e3-18d8-4a27-9ff5-d007c99d3e2e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:55:49.053715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74c4d4-4d5b-4d0a-911b-867eb6d39345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:49.054757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74c4d4-4d5b-4d0a-911b-867eb6d39345 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:49.055049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74c4d4-4d5b-4d0a-911b-867eb6d39345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:49.055332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74c4d4-4d5b-4d0a-911b-867eb6d39345 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:49.059965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-57df59e3-18d8-4a27-9ff5-d007c99d3e2e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:55:49.061200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:55:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:55:49.063938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74c4d4-4d5b-4d0a-911b-867eb6d39345 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:49.066386 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74c4d4-4d5b-4d0a-911b-867eb6d39345 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:49.067877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df59e3-18d8-4a27-9ff5-d007c99d3e2e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:49.075628 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:55:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 09 00:55:49.077170 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df59e3-18d8-4a27-9ff5-d007c99d3e2e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:49.081314 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74c4d4-4d5b-4d0a-911b-867eb6d39345 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:49.082214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa439374-f069-4f94-8849-c70a36fa8573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:49.082879 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa439374-f069-4f94-8849-c70a36fa8573 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:49.083157 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa439374-f069-4f94-8849-c70a36fa8573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:49.083436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa439374-f069-4f94-8849-c70a36fa8573 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:49.084207 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa439374-f069-4f94-8849-c70a36fa8573 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:55:49.084513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa439374-f069-4f94-8849-c70a36fa8573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:49.086282 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-aa439374-f069-4f94-8849-c70a36fa8573 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:55:49.086282 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:55:49.086282 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:55:49.087222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa439374-f069-4f94-8849-c70a36fa8573 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:49.090349 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74c4d4-4d5b-4d0a-911b-867eb6d39345 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:49.094809 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ad540-6c54-40f1-a1d6-a81236903df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:49.095572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ad540-6c54-40f1-a1d6-a81236903df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:49.095854 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ad540-6c54-40f1-a1d6-a81236903df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:49.096131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ad540-6c54-40f1-a1d6-a81236903df0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:49.097525 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ad540-6c54-40f1-a1d6-a81236903df0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:49.099306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ad540-6c54-40f1-a1d6-a81236903df0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:49.100271 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:55:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:55:49.100819 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:55:49 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:55:49.106228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa439374-f069-4f94-8849-c70a36fa8573 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:49.117213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa439374-f069-4f94-8849-c70a36fa8573 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:49.121858 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601afc14-aa30-443d-9a3b-b27dff2789db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:49.122787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601afc14-aa30-443d-9a3b-b27dff2789db admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:49.123067 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601afc14-aa30-443d-9a3b-b27dff2789db admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:49.123340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601afc14-aa30-443d-9a3b-b27dff2789db admin admin] PATH_INFO: `/v3/users/9a491d369dd94708903d971f130743aa` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:49.124647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601afc14-aa30-443d-9a3b-b27dff2789db admin admin] RBAC: Authorizing `identity:get_user(user_id=9a491d369dd94708903d971f130743aa)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:49.126557 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601afc14-aa30-443d-9a3b-b27dff2789db admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:49.129020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:55:49 2021] GET /identity/v3/users/9a491d369dd94708903d971f130743aa => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:55:49.135214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ad540-6c54-40f1-a1d6-a81236903df0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:49.145912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ad540-6c54-40f1-a1d6-a81236903df0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:49.150423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7755ef7-3641-47b9-9455-b0c52f3ba6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:49.151224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7755ef7-3641-47b9-9455-b0c52f3ba6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:49.151509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7755ef7-3641-47b9-9455-b0c52f3ba6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:49.151786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7755ef7-3641-47b9-9455-b0c52f3ba6f7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:49.153047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7755ef7-3641-47b9-9455-b0c52f3ba6f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:49.156418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7755ef7-3641-47b9-9455-b0c52f3ba6f7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:49.156598 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:55:49 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:55:49.163631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601afc14-aa30-443d-9a3b-b27dff2789db admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:49.173721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601afc14-aa30-443d-9a3b-b27dff2789db admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:49.178629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59aee6-b34f-45f9-8d9c-923ac889054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:49.179306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59aee6-b34f-45f9-8d9c-923ac889054a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:49.179594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59aee6-b34f-45f9-8d9c-923ac889054a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:49.179876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59aee6-b34f-45f9-8d9c-923ac889054a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:49.180734 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59aee6-b34f-45f9-8d9c-923ac889054a admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.domain.id=default, user.id=9a491d369dd94708903d971f130743aa) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:55:49.181049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59aee6-b34f-45f9-8d9c-923ac889054a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:49.182085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-3c59aee6-b34f-45f9-8d9c-923ac889054a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:55:49.182085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:55:49.182085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:55:49.183324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59aee6-b34f-45f9-8d9c-923ac889054a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:49.192399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1343 bytes} [Thu Dec 9 00:55:49 2021] GET /identity/v3/role_assignments?user.id=9a491d369dd94708903d971f130743aa&scope.domain.id=default&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:55:52.015824 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c94c3-fb3f-4cd8-ba0c-8e8d234241f9 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.016330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c94c3-fb3f-4cd8-ba0c-8e8d234241f9 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.016428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c94c3-fb3f-4cd8-ba0c-8e8d234241f9 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.018382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:55:52.024430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feffb0-4bbf-4a0c-901b-808ee3c1b203 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.024881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feffb0-4bbf-4a0c-901b-808ee3c1b203 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.024976 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feffb0-4bbf-4a0c-901b-808ee3c1b203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.048078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-66feffb0-4bbf-4a0c-901b-808ee3c1b203 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:52.049584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-66feffb0-4bbf-4a0c-901b-808ee3c1b203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:52.057961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 11/22] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:55:52.093486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c94c3-fb3f-4cd8-ba0c-8e8d234241f9 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:52.111912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c94c3-fb3f-4cd8-ba0c-8e8d234241f9 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:52.117425 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24178b10-6a8f-4637-aa56-ef6894ef4ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:52.118485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24178b10-6a8f-4637-aa56-ef6894ef4ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.118975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24178b10-6a8f-4637-aa56-ef6894ef4ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.119466 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24178b10-6a8f-4637-aa56-ef6894ef4ac8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.139383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24178b10-6a8f-4637-aa56-ef6894ef4ac8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:55:52.150719 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-24178b10-6a8f-4637-aa56-ef6894ef4ac8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:55:52.152047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 12/23] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:55:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:55:52.158466 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feffb0-4bbf-4a0c-901b-808ee3c1b203 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:52.168542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feffb0-4bbf-4a0c-901b-808ee3c1b203 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:52.177621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabbe98-1ba2-47ff-a122-8f301672f3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:52.178627 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabbe98-1ba2-47ff-a122-8f301672f3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.179120 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabbe98-1ba2-47ff-a122-8f301672f3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.179596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabbe98-1ba2-47ff-a122-8f301672f3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.180582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabbe98-1ba2-47ff-a122-8f301672f3d9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:55:52.181084 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabbe98-1ba2-47ff-a122-8f301672f3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:52.182916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabbe98-1ba2-47ff-a122-8f301672f3d9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:52.197285 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 12/24] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:55:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:55:52.203019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24178b10-6a8f-4637-aa56-ef6894ef4ac8 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:52.219832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24178b10-6a8f-4637-aa56-ef6894ef4ac8 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:52.230613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06394-fd12-4221-a4c9-5c00f4eeec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:52.231487 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06394-fd12-4221-a4c9-5c00f4eeec98 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.231775 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06394-fd12-4221-a4c9-5c00f4eeec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.232057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06394-fd12-4221-a4c9-5c00f4eeec98 admin admin] PATH_INFO: `/v3/users/9a491d369dd94708903d971f130743aa` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.239405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe06394-fd12-4221-a4c9-5c00f4eeec98 admin admin] RBAC: Authorizing `identity:get_user(user_id=9a491d369dd94708903d971f130743aa)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:52.241329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe06394-fd12-4221-a4c9-5c00f4eeec98 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:52.242991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 13/25] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:55:52 2021] GET /identity/v3/users/9a491d369dd94708903d971f130743aa => generated 247 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:55:52.248936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabbe98-1ba2-47ff-a122-8f301672f3d9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:52.264336 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabbe98-1ba2-47ff-a122-8f301672f3d9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:52.269194 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78447a1e-c94a-4126-9f8f-676b3fd9b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:52.270206 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78447a1e-c94a-4126-9f8f-676b3fd9b17c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.270714 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78447a1e-c94a-4126-9f8f-676b3fd9b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.271187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78447a1e-c94a-4126-9f8f-676b3fd9b17c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.272600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78447a1e-c94a-4126-9f8f-676b3fd9b17c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:52.278704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78447a1e-c94a-4126-9f8f-676b3fd9b17c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:52.280838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 13/26] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:55:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:55:52.288086 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06394-fd12-4221-a4c9-5c00f4eeec98 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:52.305030 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06394-fd12-4221-a4c9-5c00f4eeec98 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:52.314615 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35ac26-4f4f-4f77-8cb4-49a4f30fea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:52.315476 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35ac26-4f4f-4f77-8cb4-49a4f30fea40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.315800 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35ac26-4f4f-4f77-8cb4-49a4f30fea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.316283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35ac26-4f4f-4f77-8cb4-49a4f30fea40 admin admin] PATH_INFO: `/v3/domains/default/users/9a491d369dd94708903d971f130743aa/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.321953 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35ac26-4f4f-4f77-8cb4-49a4f30fea40 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9a491d369dd94708903d971f130743aa, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:52.323758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-ab35ac26-4f4f-4f77-8cb4-49a4f30fea40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:55:52.323758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:55:52.323758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:55:52.325767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35ac26-4f4f-4f77-8cb4-49a4f30fea40 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:52.495582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c07551-c47d-44a0-8503-bd8a321da42e None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.496214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c07551-c47d-44a0-8503-bd8a321da42e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.496721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c07551-c47d-44a0-8503-bd8a321da42e None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.499642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 14/27] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:55:52.507097 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2131e7-8bdc-4629-8a53-20c00490d59e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.507719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2131e7-8bdc-4629-8a53-20c00490d59e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.508228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2131e7-8bdc-4629-8a53-20c00490d59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.542937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-ce2131e7-8bdc-4629-8a53-20c00490d59e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:52.544497 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ce2131e7-8bdc-4629-8a53-20c00490d59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:52.587181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 14/28] 10.222.0.23 () {58 vars in 1382 bytes} [Thu Dec 9 00:55:52 2021] PUT /identity/v3/domains/default/users/9a491d369dd94708903d971f130743aa/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:55:52.589345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37c614-58f0-4aa8-9829-991cbc139365 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.589792 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37c614-58f0-4aa8-9829-991cbc139365 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.590221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37c614-58f0-4aa8-9829-991cbc139365 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.595592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 15/29] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:52 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:55:52.597330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dc076-cf76-4151-8cf5-24e7fc09f0dd None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.597769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dc076-cf76-4151-8cf5-24e7fc09f0dd None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.598254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dc076-cf76-4151-8cf5-24e7fc09f0dd None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.600532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:55:52.601827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc615c59-8001-4faf-a704-a9ca9ad22a7f None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.602336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc615c59-8001-4faf-a704-a9ca9ad22a7f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.602771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc615c59-8001-4faf-a704-a9ca9ad22a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.626991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 15/31] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:55:52.627723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-fc615c59-8001-4faf-a704-a9ca9ad22a7f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:52.634396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9d187-6aae-4613-83fd-b66a07464334 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.634396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9d187-6aae-4613-83fd-b66a07464334 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.634396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9d187-6aae-4613-83fd-b66a07464334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.636532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fc615c59-8001-4faf-a704-a9ca9ad22a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:52.649959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 17/32] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:55:52.669016 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc615c59-8001-4faf-a704-a9ca9ad22a7f None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:52.675518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-2cc9d187-6aae-4613-83fd-b66a07464334 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:52.676750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2cc9d187-6aae-4613-83fd-b66a07464334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:52.680754 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc615c59-8001-4faf-a704-a9ca9ad22a7f None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:52.688697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d6d23-9104-4eec-bef0-e9aba6452c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:52.691429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d6d23-9104-4eec-bef0-e9aba6452c81 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.694537 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d6d23-9104-4eec-bef0-e9aba6452c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.695458 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d6d23-9104-4eec-bef0-e9aba6452c81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.704608 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 16/33] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:55:52.705881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9d187-6aae-4613-83fd-b66a07464334 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:52.728414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9d187-6aae-4613-83fd-b66a07464334 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:52.733937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd8b33-d4fc-4689-8c57-bb69c994fe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:52.734911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd8b33-d4fc-4689-8c57-bb69c994fe41 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.735413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd8b33-d4fc-4689-8c57-bb69c994fe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.735898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd8b33-d4fc-4689-8c57-bb69c994fe41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.736916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd8b33-d4fc-4689-8c57-bb69c994fe41 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:52.747919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-68dd8b33-d4fc-4689-8c57-bb69c994fe41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:55:52.747919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:55:52.747919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:55:52.749562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd8b33-d4fc-4689-8c57-bb69c994fe41 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:52.754546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d6d23-9104-4eec-bef0-e9aba6452c81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:52.756649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d6d23-9104-4eec-bef0-e9aba6452c81 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:52.796341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-6a7d6d23-9104-4eec-bef0-e9aba6452c81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:55:52.801718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 18/34] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:55:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 134 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:55:52.804313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d6d23-9104-4eec-bef0-e9aba6452c81 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:52.825885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d6d23-9104-4eec-bef0-e9aba6452c81 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:52.841713 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acbcb0-136e-45b8-ae27-749481a18bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:52.842832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acbcb0-136e-45b8-ae27-749481a18bfd admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.843335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acbcb0-136e-45b8-ae27-749481a18bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.843820 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acbcb0-136e-45b8-ae27-749481a18bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.844814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acbcb0-136e-45b8-ae27-749481a18bfd admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:52.846223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-d4acbcb0-136e-45b8-ae27-749481a18bfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:55:52.846223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:55:52.846223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:55:52.853611 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acbcb0-136e-45b8-ae27-749481a18bfd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:52.877301 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 19/35] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 00:55:52 2021] POST /identity/v3/roles => generated 219 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:55:52.879065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acbcb0-136e-45b8-ae27-749481a18bfd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:52.891466 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acbcb0-136e-45b8-ae27-749481a18bfd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:52.897041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a1710-0472-46ce-b7e3-349f0a90816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:52.897794 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a1710-0472-46ce-b7e3-349f0a90816b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.898152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a1710-0472-46ce-b7e3-349f0a90816b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.898473 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a1710-0472-46ce-b7e3-349f0a90816b admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.899343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a1710-0472-46ce-b7e3-349f0a90816b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:55:52.899713 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a1710-0472-46ce-b7e3-349f0a90816b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:52.900858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-094a1710-0472-46ce-b7e3-349f0a90816b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:55:52.900858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:55:52.900858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:55:52.901857 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a1710-0472-46ce-b7e3-349f0a90816b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:52.923978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 20/36] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:55:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:55:52.930777 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a1710-0472-46ce-b7e3-349f0a90816b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:52.931752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 17/37] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 00:55:52 2021] POST /identity/v3/roles => generated 225 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:55:52.952527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a1710-0472-46ce-b7e3-349f0a90816b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:52.960611 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64279a6-ca1e-4722-9fc9-f78c7ca24597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:52.961307 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64279a6-ca1e-4722-9fc9-f78c7ca24597 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:52.961640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64279a6-ca1e-4722-9fc9-f78c7ca24597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:52.961925 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64279a6-ca1e-4722-9fc9-f78c7ca24597 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:52.962723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64279a6-ca1e-4722-9fc9-f78c7ca24597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:52.963921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-c64279a6-ca1e-4722-9fc9-f78c7ca24597 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:55:52.963921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:55:52.963921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:55:52.965221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64279a6-ca1e-4722-9fc9-f78c7ca24597 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:53.020820 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 21/38] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:55:52 2021] POST /identity/v3/projects => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:55:53.321747 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94867-034f-43c8-8704-81be2b58116e None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:53.322860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94867-034f-43c8-8704-81be2b58116e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:53.323356 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94867-034f-43c8-8704-81be2b58116e None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:53.325523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 18/39] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:55:53.333315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74f27-7a2f-4abd-81b5-7660a3e98c0c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:53.333961 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74f27-7a2f-4abd-81b5-7660a3e98c0c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:53.334509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74f27-7a2f-4abd-81b5-7660a3e98c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:53.367690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d5f74f27-7a2f-4abd-81b5-7660a3e98c0c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:53.369503 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d5f74f27-7a2f-4abd-81b5-7660a3e98c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:53.449014 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 22/40] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:55:53.480624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94867-034f-43c8-8704-81be2b58116e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:53.494581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94867-034f-43c8-8704-81be2b58116e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:53.500222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e508f5-6a97-4e85-8740-535a2ade9640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:53.501025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e508f5-6a97-4e85-8740-535a2ade9640 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:53.501321 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e508f5-6a97-4e85-8740-535a2ade9640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:53.501607 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e508f5-6a97-4e85-8740-535a2ade9640 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:53.502398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e508f5-6a97-4e85-8740-535a2ade9640 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:53.504854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e508f5-6a97-4e85-8740-535a2ade9640 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:53.528304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 19/41] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 00:55:53 2021] POST /identity/v3/roles => generated 223 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:55:53.776162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455fcf-ef9c-40eb-9360-f48795ae6b31 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:53.776457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455fcf-ef9c-40eb-9360-f48795ae6b31 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:53.776932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455fcf-ef9c-40eb-9360-f48795ae6b31 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:53.778770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 23/42] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:55:53.784930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922941f-e809-43f5-ad02-a777d2fe0b23 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:53.785284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922941f-e809-43f5-ad02-a777d2fe0b23 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:53.785664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922941f-e809-43f5-ad02-a777d2fe0b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:53.805565 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-5922941f-e809-43f5-ad02-a777d2fe0b23 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:53.807117 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5922941f-e809-43f5-ad02-a777d2fe0b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:53.814662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 20/43] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:55:53.840805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3455fcf-ef9c-40eb-9360-f48795ae6b31 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:53.854305 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3455fcf-ef9c-40eb-9360-f48795ae6b31 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:53.858620 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee471080-0026-47d1-9f23-536555d2745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:53.859405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee471080-0026-47d1-9f23-536555d2745c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:53.859689 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee471080-0026-47d1-9f23-536555d2745c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:53.859968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee471080-0026-47d1-9f23-536555d2745c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:53.861162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee471080-0026-47d1-9f23-536555d2745c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:53.863842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee471080-0026-47d1-9f23-536555d2745c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:53.865445 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 24/44] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:55:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:55:53.871307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922941f-e809-43f5-ad02-a777d2fe0b23 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:53.880476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922941f-e809-43f5-ad02-a777d2fe0b23 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:53.884983 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f8001-0dc6-44cf-a91e-b2636331443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:53.885631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f8001-0dc6-44cf-a91e-b2636331443e admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:53.885921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f8001-0dc6-44cf-a91e-b2636331443e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:53.886200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f8001-0dc6-44cf-a91e-b2636331443e admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:53.886969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f8001-0dc6-44cf-a91e-b2636331443e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:53.887980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-640f8001-0dc6-44cf-a91e-b2636331443e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:55:53.887980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:55:53.887980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:55:53.889209 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f8001-0dc6-44cf-a91e-b2636331443e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:53.916572 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 21/45] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:55:53 2021] POST /identity/v3/projects => generated 312 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 00:55:55.274716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8eaf6-ddd7-48b3-b857-4fe3a983a0b7 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:55.275203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8eaf6-ddd7-48b3-b857-4fe3a983a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:55.275288 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8eaf6-ddd7-48b3-b857-4fe3a983a0b7 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:55.277035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 25/46] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:55:55.283028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e27f-f270-4604-9e03-b95544223500 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:55.283448 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e27f-f270-4604-9e03-b95544223500 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:55.283591 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e27f-f270-4604-9e03-b95544223500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:55.301319 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-0a68e27f-f270-4604-9e03-b95544223500 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:55.302539 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0a68e27f-f270-4604-9e03-b95544223500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:55.355941 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 22/47] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:55:55.380305 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8eaf6-ddd7-48b3-b857-4fe3a983a0b7 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:55.392128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8eaf6-ddd7-48b3-b857-4fe3a983a0b7 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:55.396595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905860a6-3d06-44ba-9763-99462e1d0004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:55.397435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905860a6-3d06-44ba-9763-99462e1d0004 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:55.397781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905860a6-3d06-44ba-9763-99462e1d0004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:55.398120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905860a6-3d06-44ba-9763-99462e1d0004 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:55.408490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905860a6-3d06-44ba-9763-99462e1d0004 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:55:55.415409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-905860a6-3d06-44ba-9763-99462e1d0004 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:55:55.416555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 26/48] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:55:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:55:55.422470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e27f-f270-4604-9e03-b95544223500 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:55.432192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e27f-f270-4604-9e03-b95544223500 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:55.437263 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038b490-14cb-4c50-9571-e36eddad0dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:55.437923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038b490-14cb-4c50-9571-e36eddad0dce admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:55.438211 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038b490-14cb-4c50-9571-e36eddad0dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:55.438534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038b490-14cb-4c50-9571-e36eddad0dce admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:55.439301 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038b490-14cb-4c50-9571-e36eddad0dce admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:55:55.439610 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038b490-14cb-4c50-9571-e36eddad0dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:55.441871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038b490-14cb-4c50-9571-e36eddad0dce admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:55.450121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 23/49] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:55:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:55:55.455981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905860a6-3d06-44ba-9763-99462e1d0004 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:55.465499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905860a6-3d06-44ba-9763-99462e1d0004 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:55.469797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaba0b-d61f-4a47-b45a-ad5ca01b1995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:55.470665 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaba0b-d61f-4a47-b45a-ad5ca01b1995 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:55.470950 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaba0b-d61f-4a47-b45a-ad5ca01b1995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:55.471227 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaba0b-d61f-4a47-b45a-ad5ca01b1995 admin admin] PATH_INFO: `/v3/users/9a491d369dd94708903d971f130743aa` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:55.472481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaba0b-d61f-4a47-b45a-ad5ca01b1995 admin admin] RBAC: Authorizing `identity:get_user(user_id=9a491d369dd94708903d971f130743aa)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:55.474307 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaba0b-d61f-4a47-b45a-ad5ca01b1995 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:55.476038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 27/50] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:55:55 2021] GET /identity/v3/users/9a491d369dd94708903d971f130743aa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:55:55.481571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038b490-14cb-4c50-9571-e36eddad0dce admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:55.491647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038b490-14cb-4c50-9571-e36eddad0dce admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:55.495922 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb06a95-6b02-4a06-81e5-49defb34a765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:55.496683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb06a95-6b02-4a06-81e5-49defb34a765 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:55.496966 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb06a95-6b02-4a06-81e5-49defb34a765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:55.497245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb06a95-6b02-4a06-81e5-49defb34a765 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:55.498441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb06a95-6b02-4a06-81e5-49defb34a765 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:55.500117 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb06a95-6b02-4a06-81e5-49defb34a765 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:55.501649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 24/51] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:55:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:55:55.507843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaba0b-d61f-4a47-b45a-ad5ca01b1995 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:55.517008 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaba0b-d61f-4a47-b45a-ad5ca01b1995 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:55.521406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b5545-29fb-47c4-86eb-a89017ec31b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:55.522021 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b5545-29fb-47c4-86eb-a89017ec31b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:55.522304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b5545-29fb-47c4-86eb-a89017ec31b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:55.522608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b5545-29fb-47c4-86eb-a89017ec31b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:55.523430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b5545-29fb-47c4-86eb-a89017ec31b4 admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.domain.id=default, user.id=9a491d369dd94708903d971f130743aa) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:55:55.523740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b5545-29fb-47c4-86eb-a89017ec31b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:55.524716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-838b5545-29fb-47c4-86eb-a89017ec31b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:55:55.524716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:55:55.524716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:55:55.525908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b5545-29fb-47c4-86eb-a89017ec31b4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:55.533166 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 28/52] 10.222.0.23 () {56 vars in 1343 bytes} [Thu Dec 9 00:55:55 2021] GET /identity/v3/role_assignments?user.id=9a491d369dd94708903d971f130743aa&scope.domain.id=default&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:55:56.291452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5894f09-f887-4595-a8ea-371685c7f27c None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:56.291956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5894f09-f887-4595-a8ea-371685c7f27c None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:56.292042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5894f09-f887-4595-a8ea-371685c7f27c None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:56.293760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 25/53] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:55:56.299366 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ddd8d-043f-4331-b8ff-fca9c1c318f6 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:56.299751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ddd8d-043f-4331-b8ff-fca9c1c318f6 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:56.300481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ddd8d-043f-4331-b8ff-fca9c1c318f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:56.318739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-bc7ddd8d-043f-4331-b8ff-fca9c1c318f6 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:56.319932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-bc7ddd8d-043f-4331-b8ff-fca9c1c318f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:56.327389 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 29/54] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:55:56.350877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5894f09-f887-4595-a8ea-371685c7f27c None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:56.363274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5894f09-f887-4595-a8ea-371685c7f27c None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:56.367453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ea0cb-e5d4-4590-8dd4-5278020a625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:56.368215 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea0cb-e5d4-4590-8dd4-5278020a625a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:56.368497 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea0cb-e5d4-4590-8dd4-5278020a625a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:56.368771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea0cb-e5d4-4590-8dd4-5278020a625a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:56.369933 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ea0cb-e5d4-4590-8dd4-5278020a625a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:56.371647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ea0cb-e5d4-4590-8dd4-5278020a625a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:56.373177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 26/55] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:55:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:55:56.379445 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ddd8d-043f-4331-b8ff-fca9c1c318f6 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:56.388116 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ddd8d-043f-4331-b8ff-fca9c1c318f6 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:56.392534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee58a2-3676-4e06-a2b4-9e9df3cd2f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:56.393175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee58a2-3676-4e06-a2b4-9e9df3cd2f5e admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:56.393465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee58a2-3676-4e06-a2b4-9e9df3cd2f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:56.393754 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee58a2-3676-4e06-a2b4-9e9df3cd2f5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:56.394596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee58a2-3676-4e06-a2b4-9e9df3cd2f5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:56.396531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee58a2-3676-4e06-a2b4-9e9df3cd2f5e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:56.420694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 30/56] 10.222.0.23 () {60 vars in 1161 bytes} [Thu Dec 9 00:55:56 2021] POST /identity/v3/projects => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:55:58.779288 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38caeb-ff42-42cf-836f-4d2692a67b89 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:58.780060 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38caeb-ff42-42cf-836f-4d2692a67b89 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:58.780205 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38caeb-ff42-42cf-836f-4d2692a67b89 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:58.782029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 27/57] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:55:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:55:58.787885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8210842-62e2-4bfd-902d-378d067061fe None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:58.788328 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8210842-62e2-4bfd-902d-378d067061fe None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:58.788459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8210842-62e2-4bfd-902d-378d067061fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:58.808359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d8210842-62e2-4bfd-902d-378d067061fe None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:55:58.809597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d8210842-62e2-4bfd-902d-378d067061fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:55:58.865712 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 31/58] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:55:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:55:58.891552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38caeb-ff42-42cf-836f-4d2692a67b89 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:58.904009 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38caeb-ff42-42cf-836f-4d2692a67b89 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:58.908229 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b066f-011e-4c5a-81d3-9c8afab44fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:58.909001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b066f-011e-4c5a-81d3-9c8afab44fdd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:58.909327 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b066f-011e-4c5a-81d3-9c8afab44fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:58.909674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b066f-011e-4c5a-81d3-9c8afab44fdd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:58.910973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b066f-011e-4c5a-81d3-9c8afab44fdd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:58.912655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b066f-011e-4c5a-81d3-9c8afab44fdd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:58.914223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 28/59] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:55:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:55:58.919919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8210842-62e2-4bfd-902d-378d067061fe None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:55:58.928977 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8210842-62e2-4bfd-902d-378d067061fe None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:55:58.933397 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa727a2-d19f-4a24-a241-4769ed93e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:55:58.934055 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa727a2-d19f-4a24-a241-4769ed93e984 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:55:58.934349 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa727a2-d19f-4a24-a241-4769ed93e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:55:58.934658 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa727a2-d19f-4a24-a241-4769ed93e984 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:55:58.935384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa727a2-d19f-4a24-a241-4769ed93e984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:55:58.936403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-baa727a2-d19f-4a24-a241-4769ed93e984 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:55:58.936403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:55:58.936403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:55:58.937644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa727a2-d19f-4a24-a241-4769ed93e984 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:55:58.962452 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 32/60] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:55:58 2021] POST /identity/v3/users => generated 275 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:56:02.439287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e46ad-c960-4d81-8e4a-21386b861253 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.440290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e46ad-c960-4d81-8e4a-21386b861253 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.441358 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e46ad-c960-4d81-8e4a-21386b861253 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.443346 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 29/61] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:02.449535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d065d8d-6e1c-4818-9aef-f4883033ae36 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.449968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d065d8d-6e1c-4818-9aef-f4883033ae36 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.450153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d065d8d-6e1c-4818-9aef-f4883033ae36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.475196 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-4d065d8d-6e1c-4818-9aef-f4883033ae36 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:02.476413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-4d065d8d-6e1c-4818-9aef-f4883033ae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:02.490475 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 33/62] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:02.526943 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e46ad-c960-4d81-8e4a-21386b861253 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:02.547018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e46ad-c960-4d81-8e4a-21386b861253 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:02.552016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df11d22-bade-408d-a166-efb5bcf26e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:02.553041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df11d22-bade-408d-a166-efb5bcf26e03 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.553537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df11d22-bade-408d-a166-efb5bcf26e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.554038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df11d22-bade-408d-a166-efb5bcf26e03 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.568478 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df11d22-bade-408d-a166-efb5bcf26e03 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:02.575920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-2df11d22-bade-408d-a166-efb5bcf26e03 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:02.577544 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 30/63] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:02.585270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d065d8d-6e1c-4818-9aef-f4883033ae36 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:02.598750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d065d8d-6e1c-4818-9aef-f4883033ae36 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:02.606311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03505e-e902-4145-99f9-e1bbf9c647a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:02.607028 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03505e-e902-4145-99f9-e1bbf9c647a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.607313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03505e-e902-4145-99f9-e1bbf9c647a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.607590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03505e-e902-4145-99f9-e1bbf9c647a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.608368 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03505e-e902-4145-99f9-e1bbf9c647a1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:02.608677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03505e-e902-4145-99f9-e1bbf9c647a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:02.609720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-cf03505e-e902-4145-99f9-e1bbf9c647a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:02.609720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:56:02.609720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:56:02.610684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03505e-e902-4145-99f9-e1bbf9c647a1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:02.636897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 34/64] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:02.643163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df11d22-bade-408d-a166-efb5bcf26e03 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:02.654533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df11d22-bade-408d-a166-efb5bcf26e03 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:02.665772 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e201-c112-4620-b93e-b5fd2e77ecf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:02.667062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e201-c112-4620-b93e-b5fd2e77ecf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.667554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e201-c112-4620-b93e-b5fd2e77ecf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.668028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e201-c112-4620-b93e-b5fd2e77ecf3 admin admin] PATH_INFO: `/v3/users/614b9ecf23bd4252992673fa09ff13f2` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.691639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193e201-c112-4620-b93e-b5fd2e77ecf3 admin admin] RBAC: Authorizing `identity:get_user(user_id=614b9ecf23bd4252992673fa09ff13f2)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:02.694142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193e201-c112-4620-b93e-b5fd2e77ecf3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:02.696089 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 31/65] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:02 2021] GET /identity/v3/users/614b9ecf23bd4252992673fa09ff13f2 => generated 275 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:02.702102 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03505e-e902-4145-99f9-e1bbf9c647a1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:02.715720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03505e-e902-4145-99f9-e1bbf9c647a1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:02.726452 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74354f93-0975-45b5-bff6-ab15ed0b8ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:02.727405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74354f93-0975-45b5-bff6-ab15ed0b8ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.727892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74354f93-0975-45b5-bff6-ab15ed0b8ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.728389 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74354f93-0975-45b5-bff6-ab15ed0b8ec8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.742015 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74354f93-0975-45b5-bff6-ab15ed0b8ec8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:02.744088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74354f93-0975-45b5-bff6-ab15ed0b8ec8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:02.758913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 35/66] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:02.765023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e201-c112-4620-b93e-b5fd2e77ecf3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:02.769442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85001a5c-513e-4e50-b864-0672711ea65e None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.769737 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85001a5c-513e-4e50-b864-0672711ea65e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.770025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85001a5c-513e-4e50-b864-0672711ea65e None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.772006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 36/67] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:02.776704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e201-c112-4620-b93e-b5fd2e77ecf3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:02.782632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f813f5-85b7-41ed-9eac-29d6fdfaa6e2 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.782926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f813f5-85b7-41ed-9eac-29d6fdfaa6e2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.783211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f813f5-85b7-41ed-9eac-29d6fdfaa6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.795389 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39691b41-cc13-4cc0-9646-13ce8847f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:02.796265 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39691b41-cc13-4cc0-9646-13ce8847f021 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.796563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39691b41-cc13-4cc0-9646-13ce8847f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.796845 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39691b41-cc13-4cc0-9646-13ce8847f021 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.803079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39691b41-cc13-4cc0-9646-13ce8847f021 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:02.805186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39691b41-cc13-4cc0-9646-13ce8847f021 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:02.806947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 32/68] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:02 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:02.813410 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-37f813f5-85b7-41ed-9eac-29d6fdfaa6e2 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:02.814654 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-37f813f5-85b7-41ed-9eac-29d6fdfaa6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:02.816973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39691b41-cc13-4cc0-9646-13ce8847f021 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:02.827848 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39691b41-cc13-4cc0-9646-13ce8847f021 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:02.833676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 37/69] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Dec 09 00:56:02.835373 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b9943-feb2-4012-9d87-5c179eb08f49 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.835666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b9943-feb2-4012-9d87-5c179eb08f49 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.835948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b9943-feb2-4012-9d87-5c179eb08f49 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.836962 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb497b1-02e6-490c-92c5-c6ea99c18834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:02.837616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb497b1-02e6-490c-92c5-c6ea99c18834 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.837885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 38/70] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:02.837993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb497b1-02e6-490c-92c5-c6ea99c18834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.838156 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb497b1-02e6-490c-92c5-c6ea99c18834 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.839043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb497b1-02e6-490c-92c5-c6ea99c18834 admin admin] RBAC: Adding query filter params (role.id=800b8a36452a418b82e9e25cef933520, scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b, user.id=614b9ecf23bd4252992673fa09ff13f2) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:02.839361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb497b1-02e6-490c-92c5-c6ea99c18834 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:02.849178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb29fb-b444-4eb0-8d3b-f4fe735a96c6 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.849470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb29fb-b444-4eb0-8d3b-f4fe735a96c6 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.849756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb29fb-b444-4eb0-8d3b-f4fe735a96c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.855796 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb497b1-02e6-490c-92c5-c6ea99c18834 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:02.862025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 33/71] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:02 2021] GET /identity/v3/role_assignments?user.id=614b9ecf23bd4252992673fa09ff13f2&scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b&role.id=800b8a36452a418b82e9e25cef933520 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:02.863336 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb497b1-02e6-490c-92c5-c6ea99c18834 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:02.875345 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb497b1-02e6-490c-92c5-c6ea99c18834 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:02.885923 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-f3cb29fb-b444-4eb0-8d3b-f4fe735a96c6 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:02.887206 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f3cb29fb-b444-4eb0-8d3b-f4fe735a96c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:02.888812 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7b450-2ce8-45eb-b5e0-ae9d0ae5489f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:02.889644 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7b450-2ce8-45eb-b5e0-ae9d0ae5489f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.889934 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7b450-2ce8-45eb-b5e0-ae9d0ae5489f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.890219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7b450-2ce8-45eb-b5e0-ae9d0ae5489f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.910408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 39/72] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:02.911506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7b450-2ce8-45eb-b5e0-ae9d0ae5489f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:02.918515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-6ec7b450-2ce8-45eb-b5e0-ae9d0ae5489f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:56:02.920000 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 34/73] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:56:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:02.926832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb29fb-b444-4eb0-8d3b-f4fe735a96c6 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:02.936761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb29fb-b444-4eb0-8d3b-f4fe735a96c6 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:02.938413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7b450-2ce8-45eb-b5e0-ae9d0ae5489f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:02.952127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafe7dd-7366-428c-b58f-dd3d6738dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:02.952753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafe7dd-7366-428c-b58f-dd3d6738dd45 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.953039 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafe7dd-7366-428c-b58f-dd3d6738dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.953322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafe7dd-7366-428c-b58f-dd3d6738dd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.954107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafe7dd-7366-428c-b58f-dd3d6738dd45 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:02.954446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafe7dd-7366-428c-b58f-dd3d6738dd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:02.956662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafe7dd-7366-428c-b58f-dd3d6738dd45 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:02.961160 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7b450-2ce8-45eb-b5e0-ae9d0ae5489f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:02.970304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 40/74] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:02.976369 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a436f7-820b-42ea-9419-fd15f48beb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:02.977214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a436f7-820b-42ea-9419-fd15f48beb7c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:02.977504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a436f7-820b-42ea-9419-fd15f48beb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:02.977790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a436f7-820b-42ea-9419-fd15f48beb7c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:02.981432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafe7dd-7366-428c-b58f-dd3d6738dd45 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:02.998654 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafe7dd-7366-428c-b58f-dd3d6738dd45 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.004276 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a436f7-820b-42ea-9419-fd15f48beb7c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:03.011773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-e6a436f7-820b-42ea-9419-fd15f48beb7c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:03.013042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 35/75] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:03.022602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723178e-e273-4d41-bd66-a55753dc279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.023517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723178e-e273-4d41-bd66-a55753dc279b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.023808 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723178e-e273-4d41-bd66-a55753dc279b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.024091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723178e-e273-4d41-bd66-a55753dc279b admin admin] PATH_INFO: `/v3/users/9a491d369dd94708903d971f130743aa` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.025459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723178e-e273-4d41-bd66-a55753dc279b admin admin] RBAC: Authorizing `identity:get_user(user_id=9a491d369dd94708903d971f130743aa)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.027421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723178e-e273-4d41-bd66-a55753dc279b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.029341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 41/76] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:02 2021] GET /identity/v3/users/9a491d369dd94708903d971f130743aa => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:03.030174 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a436f7-820b-42ea-9419-fd15f48beb7c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.040550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723178e-e273-4d41-bd66-a55753dc279b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.047859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a436f7-820b-42ea-9419-fd15f48beb7c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.051528 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723178e-e273-4d41-bd66-a55753dc279b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.059446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750096-64e5-4ed5-b886-b48ea0a1015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.060128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750096-64e5-4ed5-b886-b48ea0a1015f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.060419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750096-64e5-4ed5-b886-b48ea0a1015f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.060706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750096-64e5-4ed5-b886-b48ea0a1015f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.061951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d229e-5944-450a-9064-2cc86cfa260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.062655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d229e-5944-450a-9064-2cc86cfa260f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.062938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d229e-5944-450a-9064-2cc86cfa260f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.063214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d229e-5944-450a-9064-2cc86cfa260f admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.063995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d229e-5944-450a-9064-2cc86cfa260f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:03.064307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d229e-5944-450a-9064-2cc86cfa260f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.066021 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d229e-5944-450a-9064-2cc86cfa260f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.075990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4750096-64e5-4ed5-b886-b48ea0a1015f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.077826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4750096-64e5-4ed5-b886-b48ea0a1015f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.080005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 36/77] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:03.082500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb167d6a-26f0-4913-adce-8ab421a932a9 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.083022 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb167d6a-26f0-4913-adce-8ab421a932a9 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.083524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb167d6a-26f0-4913-adce-8ab421a932a9 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.085814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 37/78] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:03.090401 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb167d6a-26f0-4913-adce-8ab421a932a9 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.090560 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 42/79] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 09 00:56:03.095989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d3889-1b9f-4b35-9cbc-959118780942 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.096287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d3889-1b9f-4b35-9cbc-959118780942 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.096630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d3889-1b9f-4b35-9cbc-959118780942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.115810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb167d6a-26f0-4913-adce-8ab421a932a9 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.120941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-fb9d3889-1b9f-4b35-9cbc-959118780942 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:03.121446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c33f5-7908-45b3-a4b6-a6b061816765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.122161 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fb9d3889-1b9f-4b35-9cbc-959118780942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:03.122355 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c33f5-7908-45b3-a4b6-a6b061816765 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.122635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c33f5-7908-45b3-a4b6-a6b061816765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.122914 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c33f5-7908-45b3-a4b6-a6b061816765 admin admin] PATH_INFO: `/v3/users/614b9ecf23bd4252992673fa09ff13f2` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.124551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c33f5-7908-45b3-a4b6-a6b061816765 admin admin] RBAC: Authorizing `identity:get_user(user_id=614b9ecf23bd4252992673fa09ff13f2)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.126754 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c33f5-7908-45b3-a4b6-a6b061816765 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.128498 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 38/80] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/users/614b9ecf23bd4252992673fa09ff13f2 => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:03.129268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c33f5-7908-45b3-a4b6-a6b061816765 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.130139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 43/81] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:03.131480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40907a83-d28f-4d77-9656-8b6e12a7689f None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.131776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40907a83-d28f-4d77-9656-8b6e12a7689f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.132056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40907a83-d28f-4d77-9656-8b6e12a7689f None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.134007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 44/82] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:03.139954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3674b99-3216-4348-8220-2a4379190fd2 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.140246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3674b99-3216-4348-8220-2a4379190fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.140537 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3674b99-3216-4348-8220-2a4379190fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.148142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c33f5-7908-45b3-a4b6-a6b061816765 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.153551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d41d8-1bdf-4e4f-82f2-e6bfc6538e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.154876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d41d8-1bdf-4e4f-82f2-e6bfc6538e57 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.155168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d41d8-1bdf-4e4f-82f2-e6bfc6538e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.155456 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d41d8-1bdf-4e4f-82f2-e6bfc6538e57 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.157000 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d41d8-1bdf-4e4f-82f2-e6bfc6538e57 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.159825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d41d8-1bdf-4e4f-82f2-e6bfc6538e57 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.160561 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a3674b99-3216-4348-8220-2a4379190fd2 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:03.161703 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 39/83] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:03.161874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a3674b99-3216-4348-8220-2a4379190fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:03.162393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d41d8-1bdf-4e4f-82f2-e6bfc6538e57 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.174531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 45/84] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:03.175725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3674b99-3216-4348-8220-2a4379190fd2 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.179980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d41d8-1bdf-4e4f-82f2-e6bfc6538e57 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.184686 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d7108-b0e1-4c09-8c9c-fa84925fe529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.185360 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3674b99-3216-4348-8220-2a4379190fd2 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.185743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d7108-b0e1-4c09-8c9c-fa84925fe529 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.186287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d7108-b0e1-4c09-8c9c-fa84925fe529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.186835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d7108-b0e1-4c09-8c9c-fa84925fe529 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.191050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30267581-278f-43c6-a8e4-2c3337cc0895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.192209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30267581-278f-43c6-a8e4-2c3337cc0895 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.192578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30267581-278f-43c6-a8e4-2c3337cc0895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.192926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30267581-278f-43c6-a8e4-2c3337cc0895 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.197289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d7108-b0e1-4c09-8c9c-fa84925fe529 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.199381 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d7108-b0e1-4c09-8c9c-fa84925fe529 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.204290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30267581-278f-43c6-a8e4-2c3337cc0895 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:03.209420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 40/85] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:03.210453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d7108-b0e1-4c09-8c9c-fa84925fe529 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.211917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-30267581-278f-43c6-a8e4-2c3337cc0895 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:03.213405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 46/86] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:03.214246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30267581-278f-43c6-a8e4-2c3337cc0895 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.222233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d7108-b0e1-4c09-8c9c-fa84925fe529 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.226569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aebc84-caa5-423d-9c8f-efed98fe1d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.227215 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aebc84-caa5-423d-9c8f-efed98fe1d3a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.227500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aebc84-caa5-423d-9c8f-efed98fe1d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.227779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aebc84-caa5-423d-9c8f-efed98fe1d3a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.228624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aebc84-caa5-423d-9c8f-efed98fe1d3a admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b, user.id=9a491d369dd94708903d971f130743aa) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:03.228937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aebc84-caa5-423d-9c8f-efed98fe1d3a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.229618 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30267581-278f-43c6-a8e4-2c3337cc0895 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.230961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aebc84-caa5-423d-9c8f-efed98fe1d3a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.234338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade1788-efa5-4142-ad13-4c5813f3eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.234984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade1788-efa5-4142-ad13-4c5813f3eda3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.235272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade1788-efa5-4142-ad13-4c5813f3eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.235554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade1788-efa5-4142-ad13-4c5813f3eda3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.236738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade1788-efa5-4142-ad13-4c5813f3eda3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.246436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 41/87] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/role_assignments?user.id=9a491d369dd94708903d971f130743aa&scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:03.246436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aebc84-caa5-423d-9c8f-efed98fe1d3a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.246724 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade1788-efa5-4142-ad13-4c5813f3eda3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.246724 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 47/88] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:03.246724 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade1788-efa5-4142-ad13-4c5813f3eda3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.257924 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade1788-efa5-4142-ad13-4c5813f3eda3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.258147 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aebc84-caa5-423d-9c8f-efed98fe1d3a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.262914 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e626a-1af4-42eb-9f8b-576235940525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.263265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f561565-f376-4263-8ee8-278108588412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.263968 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e626a-1af4-42eb-9f8b-576235940525 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.264076 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f561565-f376-4263-8ee8-278108588412 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.264375 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e626a-1af4-42eb-9f8b-576235940525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.264475 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f561565-f376-4263-8ee8-278108588412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.264768 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e626a-1af4-42eb-9f8b-576235940525 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.264877 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f561565-f376-4263-8ee8-278108588412 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.265810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f561565-f376-4263-8ee8-278108588412 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:03.266197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f561565-f376-4263-8ee8-278108588412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.266309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e626a-1af4-42eb-9f8b-576235940525 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.268013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f561565-f376-4263-8ee8-278108588412 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.268801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e626a-1af4-42eb-9f8b-576235940525 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.271152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 42/89] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:03.272031 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e626a-1af4-42eb-9f8b-576235940525 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.282259 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e626a-1af4-42eb-9f8b-576235940525 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.283731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 48/90] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:03.285371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f561565-f376-4263-8ee8-278108588412 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.288129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b556634-924d-49a6-8b1f-32931299ee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.288799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556634-924d-49a6-8b1f-32931299ee8b admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.289088 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556634-924d-49a6-8b1f-32931299ee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.289370 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556634-924d-49a6-8b1f-32931299ee8b admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.290117 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b556634-924d-49a6-8b1f-32931299ee8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.291321 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-5b556634-924d-49a6-8b1f-32931299ee8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:03.291321 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:56:03.291321 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:56:03.292576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b556634-924d-49a6-8b1f-32931299ee8b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.297040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f561565-f376-4263-8ee8-278108588412 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.302492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45092265-58fa-476a-a89e-57074dec4b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.303488 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45092265-58fa-476a-a89e-57074dec4b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.304000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45092265-58fa-476a-a89e-57074dec4b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.304986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45092265-58fa-476a-a89e-57074dec4b8e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.306075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45092265-58fa-476a-a89e-57074dec4b8e admin admin] RBAC: Adding query filter params (role.id=1dbfc98083ce41ea943fbb3de6be133e, scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b, user.id=614b9ecf23bd4252992673fa09ff13f2) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:03.306967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45092265-58fa-476a-a89e-57074dec4b8e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.309478 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45092265-58fa-476a-a89e-57074dec4b8e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.322757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 49/91] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/role_assignments?user.id=614b9ecf23bd4252992673fa09ff13f2&scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b&role.id=1dbfc98083ce41ea943fbb3de6be133e => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:03.324629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45092265-58fa-476a-a89e-57074dec4b8e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.335149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 43/92] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:56:03 2021] POST /identity/v3/users => generated 289 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:56:03.349104 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45092265-58fa-476a-a89e-57074dec4b8e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.355892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20db96-f7bb-4ee2-be2a-15090efcdf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.356796 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20db96-f7bb-4ee2-be2a-15090efcdf98 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.357176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20db96-f7bb-4ee2-be2a-15090efcdf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.357460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20db96-f7bb-4ee2-be2a-15090efcdf98 admin admin] PATH_INFO: `/v3/users/614b9ecf23bd4252992673fa09ff13f2` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.362555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20db96-f7bb-4ee2-be2a-15090efcdf98 admin admin] RBAC: Authorizing `identity:get_user(user_id=614b9ecf23bd4252992673fa09ff13f2)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.365238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20db96-f7bb-4ee2-be2a-15090efcdf98 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.367177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 50/93] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/users/614b9ecf23bd4252992673fa09ff13f2 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:03.373655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b556634-924d-49a6-8b1f-32931299ee8b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.386773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b556634-924d-49a6-8b1f-32931299ee8b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.396073 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e75ee-a0d4-42a5-a589-8e1e2ea07a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.396888 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e75ee-a0d4-42a5-a589-8e1e2ea07a18 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.397229 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e75ee-a0d4-42a5-a589-8e1e2ea07a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.397515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e75ee-a0d4-42a5-a589-8e1e2ea07a18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.408439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e75ee-a0d4-42a5-a589-8e1e2ea07a18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.410571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e75ee-a0d4-42a5-a589-8e1e2ea07a18 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.426309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 44/94] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:03.433148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20db96-f7bb-4ee2-be2a-15090efcdf98 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.448839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20db96-f7bb-4ee2-be2a-15090efcdf98 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.456314 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a483b-e600-44d8-9680-36823244b38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.457451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a483b-e600-44d8-9680-36823244b38d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.457796 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a483b-e600-44d8-9680-36823244b38d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.458084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a483b-e600-44d8-9680-36823244b38d admin admin] PATH_INFO: `/v3/projects/bbf2319f60534d6dae250989069a87c3` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.463264 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a483b-e600-44d8-9680-36823244b38d admin admin] RBAC: Authorizing `identity:get_project(project_id=bbf2319f60534d6dae250989069a87c3)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.465624 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a483b-e600-44d8-9680-36823244b38d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.467999 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 51/95] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/projects/bbf2319f60534d6dae250989069a87c3 => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:03.475267 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e75ee-a0d4-42a5-a589-8e1e2ea07a18 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:03.485371 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e75ee-a0d4-42a5-a589-8e1e2ea07a18 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:03.491727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2cffb-c6f1-4403-a1aa-b4cef60a88de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:03.492666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2cffb-c6f1-4403-a1aa-b4cef60a88de admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:03.493108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2cffb-c6f1-4403-a1aa-b4cef60a88de admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:03.493676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2cffb-c6f1-4403-a1aa-b4cef60a88de admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:03.495411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2cffb-c6f1-4403-a1aa-b4cef60a88de admin admin] RBAC: Adding query filter params (role.id=800b8a36452a418b82e9e25cef933520, scope.project.id=bbf2319f60534d6dae250989069a87c3, user.id=614b9ecf23bd4252992673fa09ff13f2) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:03.495732 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2cffb-c6f1-4403-a1aa-b4cef60a88de admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:03.498650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2cffb-c6f1-4403-a1aa-b4cef60a88de admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:03.506577 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 45/96] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:03 2021] GET /identity/v3/role_assignments?user.id=614b9ecf23bd4252992673fa09ff13f2&scope.project.id=bbf2319f60534d6dae250989069a87c3&role.id=800b8a36452a418b82e9e25cef933520 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:05.626882 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913177a-20e9-4f52-86ae-d54330e2da2e None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:05.627606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913177a-20e9-4f52-86ae-d54330e2da2e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:05.627606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913177a-20e9-4f52-86ae-d54330e2da2e None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:05.629900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 52/97] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:05.649036 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ece561-72cd-496f-9e35-79b760abe451 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:05.649662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ece561-72cd-496f-9e35-79b760abe451 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:05.650022 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ece561-72cd-496f-9e35-79b760abe451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:05.674425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-86ece561-72cd-496f-9e35-79b760abe451 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:05.676593 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-86ece561-72cd-496f-9e35-79b760abe451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:05.688467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 46/98] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:05.728448 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913177a-20e9-4f52-86ae-d54330e2da2e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:05.744103 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913177a-20e9-4f52-86ae-d54330e2da2e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:05.750945 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d3c66-5b84-48bd-8693-f324112fbb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:05.751739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3c66-5b84-48bd-8693-f324112fbb42 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:05.752022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3c66-5b84-48bd-8693-f324112fbb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:05.752299 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3c66-5b84-48bd-8693-f324112fbb42 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:05.765764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d3c66-5b84-48bd-8693-f324112fbb42 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:05.772916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-4a7d3c66-5b84-48bd-8693-f324112fbb42 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:05.774134 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 53/99] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:05.780478 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ece561-72cd-496f-9e35-79b760abe451 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:05.790388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ece561-72cd-496f-9e35-79b760abe451 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:05.798802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67df9a-78c0-4c07-9082-408373482c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:05.799481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67df9a-78c0-4c07-9082-408373482c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:05.799992 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67df9a-78c0-4c07-9082-408373482c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:05.800403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67df9a-78c0-4c07-9082-408373482c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:05.801187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67df9a-78c0-4c07-9082-408373482c27 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:05.801499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67df9a-78c0-4c07-9082-408373482c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:05.803184 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67df9a-78c0-4c07-9082-408373482c27 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:05.812452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 47/100] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:05.818765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d3c66-5b84-48bd-8693-f324112fbb42 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:05.832748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d3c66-5b84-48bd-8693-f324112fbb42 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:05.840314 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a4bbd-49c4-4432-841c-0eee3a1cd0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:05.841201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a4bbd-49c4-4432-841c-0eee3a1cd0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:05.841486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a4bbd-49c4-4432-841c-0eee3a1cd0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:05.841767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a4bbd-49c4-4432-841c-0eee3a1cd0c2 admin admin] PATH_INFO: `/v3/users/614b9ecf23bd4252992673fa09ff13f2` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:05.843045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a4bbd-49c4-4432-841c-0eee3a1cd0c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=614b9ecf23bd4252992673fa09ff13f2)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:05.845248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a4bbd-49c4-4432-841c-0eee3a1cd0c2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:05.847041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 54/101] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:05 2021] GET /identity/v3/users/614b9ecf23bd4252992673fa09ff13f2 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:05.853168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67df9a-78c0-4c07-9082-408373482c27 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:05.864618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67df9a-78c0-4c07-9082-408373482c27 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:05.874867 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf4206-29b5-48d7-b7df-639724049beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:05.875760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf4206-29b5-48d7-b7df-639724049beb admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:05.876049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf4206-29b5-48d7-b7df-639724049beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:05.876329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf4206-29b5-48d7-b7df-639724049beb admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:05.877761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf4206-29b5-48d7-b7df-639724049beb admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:05.879959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf4206-29b5-48d7-b7df-639724049beb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:05.881765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 48/102] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:05 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:05.888153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a4bbd-49c4-4432-841c-0eee3a1cd0c2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:05.900771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a4bbd-49c4-4432-841c-0eee3a1cd0c2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:05.910671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afb21b-3b63-43a6-9ce8-783027588135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:05.911587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afb21b-3b63-43a6-9ce8-783027588135 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:05.911873 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afb21b-3b63-43a6-9ce8-783027588135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:05.912155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afb21b-3b63-43a6-9ce8-783027588135 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b/users/614b9ecf23bd4252992673fa09ff13f2/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:05.920015 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afb21b-3b63-43a6-9ce8-783027588135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbc52dd5f424931a362b9a5e7697c8b, user_id=614b9ecf23bd4252992673fa09ff13f2, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:05.922815 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afb21b-3b63-43a6-9ce8-783027588135 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:05.952670 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 55/103] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:05 2021] PUT /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b/users/614b9ecf23bd4252992673fa09ff13f2/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:06.515677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac9b4e-39dc-4716-91c0-01c16f4ff3e6 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.516361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac9b4e-39dc-4716-91c0-01c16f4ff3e6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.516845 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac9b4e-39dc-4716-91c0-01c16f4ff3e6 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.519507 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 49/104] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:06.525974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c02db-dbe1-4c47-a16e-82f6dabeefed None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.526268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c02db-dbe1-4c47-a16e-82f6dabeefed None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.526584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c02db-dbe1-4c47-a16e-82f6dabeefed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.539863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba138b5-94fa-457b-8c0b-43818d941fb2 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.540481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba138b5-94fa-457b-8c0b-43818d941fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.540960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba138b5-94fa-457b-8c0b-43818d941fb2 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.542993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 50/105] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:06.548867 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101e85c-5407-40ee-8fb5-fcc4e2b5a7d7 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.549395 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101e85c-5407-40ee-8fb5-fcc4e2b5a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.549993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101e85c-5407-40ee-8fb5-fcc4e2b5a7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.555409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-cf3c02db-dbe1-4c47-a16e-82f6dabeefed None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:06.556629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cf3c02db-dbe1-4c47-a16e-82f6dabeefed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:06.578329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e101e85c-5407-40ee-8fb5-fcc4e2b5a7d7 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:06.580303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e101e85c-5407-40ee-8fb5-fcc4e2b5a7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:06.657903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 51/106] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:06.668797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 56/107] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:06.686011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101e85c-5407-40ee-8fb5-fcc4e2b5a7d7 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:06.698755 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101e85c-5407-40ee-8fb5-fcc4e2b5a7d7 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:06.704531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dabc43-d1ec-4d8c-96bd-74648baa6971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:06.705393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dabc43-d1ec-4d8c-96bd-74648baa6971 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.705687 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dabc43-d1ec-4d8c-96bd-74648baa6971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.706529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dabc43-d1ec-4d8c-96bd-74648baa6971 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.711756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c02db-dbe1-4c47-a16e-82f6dabeefed None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:06.725377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c02db-dbe1-4c47-a16e-82f6dabeefed None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:06.731918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2a481-0489-45af-866e-dbd8f8842265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:06.733477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2a481-0489-45af-866e-dbd8f8842265 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.733810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2a481-0489-45af-866e-dbd8f8842265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.734097 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2a481-0489-45af-866e-dbd8f8842265 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.743044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dabc43-d1ec-4d8c-96bd-74648baa6971 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:06.755836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-e8dabc43-d1ec-4d8c-96bd-74648baa6971 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:06.757313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 52/108] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:06.763411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dabc43-d1ec-4d8c-96bd-74648baa6971 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:06.774358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2a481-0489-45af-866e-dbd8f8842265 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:06.780652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dabc43-d1ec-4d8c-96bd-74648baa6971 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:06.781751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-90f2a481-0489-45af-866e-dbd8f8842265 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:56:06.783066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 57/109] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:56:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:06.791916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556f108-ee53-45ef-affc-4919870c6715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:06.793028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556f108-ee53-45ef-affc-4919870c6715 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.793512 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556f108-ee53-45ef-affc-4919870c6715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.793999 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556f108-ee53-45ef-affc-4919870c6715 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.794983 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556f108-ee53-45ef-affc-4919870c6715 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:06.795487 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556f108-ee53-45ef-affc-4919870c6715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:06.797313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556f108-ee53-45ef-affc-4919870c6715 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:06.802403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2a481-0489-45af-866e-dbd8f8842265 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:06.812792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 53/110] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:06.816612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2a481-0489-45af-866e-dbd8f8842265 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:06.822255 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556f108-ee53-45ef-affc-4919870c6715 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:06.825901 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eddac4-83d1-4727-8788-8288719739fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:06.826772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eddac4-83d1-4727-8788-8288719739fc admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.827067 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eddac4-83d1-4727-8788-8288719739fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.827406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eddac4-83d1-4727-8788-8288719739fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.828185 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eddac4-83d1-4727-8788-8288719739fc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:06.828499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eddac4-83d1-4727-8788-8288719739fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:06.830286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eddac4-83d1-4727-8788-8288719739fc admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:06.852012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 58/111] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:06.860958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556f108-ee53-45ef-affc-4919870c6715 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:06.866874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eddac4-83d1-4727-8788-8288719739fc admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:06.871639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a283c-8f28-46ae-8203-58933dde8be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:06.872868 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a283c-8f28-46ae-8203-58933dde8be1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.873347 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a283c-8f28-46ae-8203-58933dde8be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.873817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a283c-8f28-46ae-8203-58933dde8be1 admin admin] PATH_INFO: `/v3/users/614b9ecf23bd4252992673fa09ff13f2` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.879184 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a283c-8f28-46ae-8203-58933dde8be1 admin admin] RBAC: Authorizing `identity:get_user(user_id=614b9ecf23bd4252992673fa09ff13f2)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:06.881624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a283c-8f28-46ae-8203-58933dde8be1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:06.883820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 54/112] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:06 2021] GET /identity/v3/users/614b9ecf23bd4252992673fa09ff13f2 => generated 275 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:06.884317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eddac4-83d1-4727-8788-8288719739fc admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:06.890621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a283c-8f28-46ae-8203-58933dde8be1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:06.895544 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89691b8-295e-4948-b393-d0eed5fa1554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:06.896487 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89691b8-295e-4948-b393-d0eed5fa1554 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.896776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89691b8-295e-4948-b393-d0eed5fa1554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.897119 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89691b8-295e-4948-b393-d0eed5fa1554 admin admin] PATH_INFO: `/v3/users/9a491d369dd94708903d971f130743aa` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.898418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89691b8-295e-4948-b393-d0eed5fa1554 admin admin] RBAC: Authorizing `identity:get_user(user_id=9a491d369dd94708903d971f130743aa)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:06.902405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89691b8-295e-4948-b393-d0eed5fa1554 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:06.906556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 59/113] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:06 2021] GET /identity/v3/users/9a491d369dd94708903d971f130743aa => generated 247 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:06.908758 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a283c-8f28-46ae-8203-58933dde8be1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:06.916551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89691b8-295e-4948-b393-d0eed5fa1554 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:06.918981 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5b847-0693-41ab-9c36-1069c82a1a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:06.920058 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5b847-0693-41ab-9c36-1069c82a1a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.920555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5b847-0693-41ab-9c36-1069c82a1a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.921024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5b847-0693-41ab-9c36-1069c82a1a1d admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.927138 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5b847-0693-41ab-9c36-1069c82a1a1d admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:06.929447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5b847-0693-41ab-9c36-1069c82a1a1d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:06.931681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 55/114] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:06 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:06.931803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89691b8-295e-4948-b393-d0eed5fa1554 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:06.937132 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb01713-3246-4fc4-8af6-a4f536f1f2c9 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.937635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb01713-3246-4fc4-8af6-a4f536f1f2c9 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.938119 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb01713-3246-4fc4-8af6-a4f536f1f2c9 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.940017 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 56/115] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:06.945197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4483e2-8819-4029-a776-08e6c76925fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:06.945197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4483e2-8819-4029-a776-08e6c76925fb admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.945197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4483e2-8819-4029-a776-08e6c76925fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.945197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4483e2-8819-4029-a776-08e6c76925fb admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.945512 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4483e2-8819-4029-a776-08e6c76925fb admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:06.946987 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35977bd9-e648-4416-b4a7-6b5eae40e344 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.947358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4483e2-8819-4029-a776-08e6c76925fb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:06.947676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35977bd9-e648-4416-b4a7-6b5eae40e344 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.948141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35977bd9-e648-4416-b4a7-6b5eae40e344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.949224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 60/116] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:06 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:06.956615 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4483e2-8819-4029-a776-08e6c76925fb admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:06.979330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4483e2-8819-4029-a776-08e6c76925fb admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:06.988025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbece98-fb02-4685-a5d4-ce9c5e0eeaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:06.989131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbece98-fb02-4685-a5d4-ce9c5e0eeaa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:06.989608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbece98-fb02-4685-a5d4-ce9c5e0eeaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:06.990739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-35977bd9-e648-4416-b4a7-6b5eae40e344 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:06.991220 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbece98-fb02-4685-a5d4-ce9c5e0eeaa3 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b/users/614b9ecf23bd4252992673fa09ff13f2/roles/1dbfc98083ce41ea943fbb3de6be133e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:06.993620 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-35977bd9-e648-4416-b4a7-6b5eae40e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:06.995081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbece98-fb02-4685-a5d4-ce9c5e0eeaa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbc52dd5f424931a362b9a5e7697c8b, user_id=614b9ecf23bd4252992673fa09ff13f2, role_id=1dbfc98083ce41ea943fbb3de6be133e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:06.998812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbece98-fb02-4685-a5d4-ce9c5e0eeaa3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:07.009729 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 57/117] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:07.010800 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35977bd9-e648-4416-b4a7-6b5eae40e344 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:07.029157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 61/118] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:06 2021] PUT /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b/users/614b9ecf23bd4252992673fa09ff13f2/roles/1dbfc98083ce41ea943fbb3de6be133e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:07.038656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35977bd9-e648-4416-b4a7-6b5eae40e344 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:07.039609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbece98-fb02-4685-a5d4-ce9c5e0eeaa3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:07.165874 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a43d46-2af3-4adc-a413-4bf346b69301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:07.166824 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a43d46-2af3-4adc-a413-4bf346b69301 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.167110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a43d46-2af3-4adc-a413-4bf346b69301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.167388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a43d46-2af3-4adc-a413-4bf346b69301 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b/users/9a491d369dd94708903d971f130743aa/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.173133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a43d46-2af3-4adc-a413-4bf346b69301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbc52dd5f424931a362b9a5e7697c8b, user_id=9a491d369dd94708903d971f130743aa, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:07.174179 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-59a43d46-2af3-4adc-a413-4bf346b69301 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:07.174179 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:56:07.174179 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:56:07.175918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbece98-fb02-4685-a5d4-ce9c5e0eeaa3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:07.178458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a43d46-2af3-4adc-a413-4bf346b69301 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:07.188354 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8fe19-6186-4c23-b786-16110c9eaaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:07.189294 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8fe19-6186-4c23-b786-16110c9eaaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.189583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8fe19-6186-4c23-b786-16110c9eaaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.190904 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8fe19-6186-4c23-b786-16110c9eaaa1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.214541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 58/119] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:07 2021] PUT /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b/users/9a491d369dd94708903d971f130743aa/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:07.220602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8fe19-6186-4c23-b786-16110c9eaaa1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:07.228487 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-70e8fe19-6186-4c23-b786-16110c9eaaa1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:07.234565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 62/120] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:07 2021] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:07.236851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a43d46-2af3-4adc-a413-4bf346b69301 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:07.262593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bc4ff-8231-4106-abb5-27a61d70e389 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.262926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bc4ff-8231-4106-abb5-27a61d70e389 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.263211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bc4ff-8231-4106-abb5-27a61d70e389 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.265113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 63/121] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:07.271890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85f3f8-c740-451a-9b01-6a013f1514bc None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.272171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85f3f8-c740-451a-9b01-6a013f1514bc None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.272452 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85f3f8-c740-451a-9b01-6a013f1514bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.303601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ef85f3f8-c740-451a-9b01-6a013f1514bc None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:07.304749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ef85f3f8-c740-451a-9b01-6a013f1514bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:07.369924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a43d46-2af3-4adc-a413-4bf346b69301 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:07.373851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 64/122] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:07.388195 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b8e76-c74c-468f-b157-7cf2972b6e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:07.388890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b8e76-c74c-468f-b157-7cf2972b6e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.389181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b8e76-c74c-468f-b157-7cf2972b6e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.389465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b8e76-c74c-468f-b157-7cf2972b6e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.390247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b8e76-c74c-468f-b157-7cf2972b6e38 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:07.390588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b8e76-c74c-468f-b157-7cf2972b6e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:07.392250 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b8e76-c74c-468f-b157-7cf2972b6e38 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:07.400176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85f3f8-c740-451a-9b01-6a013f1514bc None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:07.408640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 59/123] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:07.413127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85f3f8-c740-451a-9b01-6a013f1514bc None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:07.418269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b8e76-c74c-468f-b157-7cf2972b6e38 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:07.420453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d757b74-ddb6-4734-88a0-6dedabdea099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:07.421359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d757b74-ddb6-4734-88a0-6dedabdea099 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.421718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d757b74-ddb6-4734-88a0-6dedabdea099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.422066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d757b74-ddb6-4734-88a0-6dedabdea099 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.432205 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b8e76-c74c-468f-b157-7cf2972b6e38 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:07.434900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d757b74-ddb6-4734-88a0-6dedabdea099 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:07.442873 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-2d757b74-ddb6-4734-88a0-6dedabdea099 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 09 00:56:07.444479 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 65/124] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:07 2021] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:07.448663 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fb21a-5ff1-46e1-baff-f98c912c8cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:07.449553 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fb21a-5ff1-46e1-baff-f98c912c8cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.449878 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fb21a-5ff1-46e1-baff-f98c912c8cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.450114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fb21a-5ff1-46e1-baff-f98c912c8cb0 admin admin] PATH_INFO: `/v3/users/614b9ecf23bd4252992673fa09ff13f2` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.452647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d757b74-ddb6-4734-88a0-6dedabdea099 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:07.455315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fb21a-5ff1-46e1-baff-f98c912c8cb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=614b9ecf23bd4252992673fa09ff13f2)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:07.458183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fb21a-5ff1-46e1-baff-f98c912c8cb0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:07.459955 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 60/125] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:07 2021] GET /identity/v3/users/614b9ecf23bd4252992673fa09ff13f2 => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:07.466295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d757b74-ddb6-4734-88a0-6dedabdea099 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:07.471807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fb21a-5ff1-46e1-baff-f98c912c8cb0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:07.474763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39565f2-383d-445f-8b8e-a843e7df2662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:07.475458 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39565f2-383d-445f-8b8e-a843e7df2662 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.475747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39565f2-383d-445f-8b8e-a843e7df2662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.476029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39565f2-383d-445f-8b8e-a843e7df2662 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.476856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39565f2-383d-445f-8b8e-a843e7df2662 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:07.477174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39565f2-383d-445f-8b8e-a843e7df2662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:07.478853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39565f2-383d-445f-8b8e-a843e7df2662 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:07.493038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fb21a-5ff1-46e1-baff-f98c912c8cb0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:07.494841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 66/126] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:07 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:07.497205 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39565f2-383d-445f-8b8e-a843e7df2662 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:07.507821 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39565f2-383d-445f-8b8e-a843e7df2662 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:07.511071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66d388-1e57-4e95-ab44-7527723ca4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:07.511969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66d388-1e57-4e95-ab44-7527723ca4cf admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.512261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66d388-1e57-4e95-ab44-7527723ca4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.512427 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ee013-8974-478c-82be-dd30fee1c1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:07.512672 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66d388-1e57-4e95-ab44-7527723ca4cf admin admin] PATH_INFO: `/v3/projects/bbf2319f60534d6dae250989069a87c3` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.513281 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ee013-8974-478c-82be-dd30fee1c1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.513570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ee013-8974-478c-82be-dd30fee1c1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.513817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66d388-1e57-4e95-ab44-7527723ca4cf admin admin] RBAC: Authorizing `identity:get_project(project_id=bbf2319f60534d6dae250989069a87c3)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:07.513972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ee013-8974-478c-82be-dd30fee1c1f2 admin admin] PATH_INFO: `/v3/users/428f2d45101e44c4a85e0b2fe4ff7672` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.515958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66d388-1e57-4e95-ab44-7527723ca4cf admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:07.517733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 61/127] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:07 2021] GET /identity/v3/projects/bbf2319f60534d6dae250989069a87c3 => generated 312 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:07.538730 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ee013-8974-478c-82be-dd30fee1c1f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=428f2d45101e44c4a85e0b2fe4ff7672)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:07.542275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ee013-8974-478c-82be-dd30fee1c1f2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:07.544686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 67/128] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:07 2021] GET /identity/v3/users/428f2d45101e44c4a85e0b2fe4ff7672 => generated 289 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:07.546247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66d388-1e57-4e95-ab44-7527723ca4cf admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:07.552933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ee013-8974-478c-82be-dd30fee1c1f2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:07.563738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ee013-8974-478c-82be-dd30fee1c1f2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:07.567657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66d388-1e57-4e95-ab44-7527723ca4cf admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:07.570749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2374737-1f01-47f7-b9bb-8fe42c68bb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:07.571603 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2374737-1f01-47f7-b9bb-8fe42c68bb62 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.571893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2374737-1f01-47f7-b9bb-8fe42c68bb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.572177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2374737-1f01-47f7-b9bb-8fe42c68bb62 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.582134 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2374737-1f01-47f7-b9bb-8fe42c68bb62 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:07.583746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee98379-1e6f-4e32-9cb4-00391545280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:07.584082 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2374737-1f01-47f7-b9bb-8fe42c68bb62 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:07.584670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee98379-1e6f-4e32-9cb4-00391545280d admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.584959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee98379-1e6f-4e32-9cb4-00391545280d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.585242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee98379-1e6f-4e32-9cb4-00391545280d admin admin] PATH_INFO: `/v3/projects/bbf2319f60534d6dae250989069a87c3/users/614b9ecf23bd4252992673fa09ff13f2/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.592124 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee98379-1e6f-4e32-9cb4-00391545280d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf2319f60534d6dae250989069a87c3, user_id=614b9ecf23bd4252992673fa09ff13f2, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:07.594215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 68/129] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 09 00:56:07.594913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee98379-1e6f-4e32-9cb4-00391545280d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:07.608012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2374737-1f01-47f7-b9bb-8fe42c68bb62 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:07.620018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2374737-1f01-47f7-b9bb-8fe42c68bb62 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:07.623487 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 62/130] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:07 2021] PUT /identity/v3/projects/bbf2319f60534d6dae250989069a87c3/users/614b9ecf23bd4252992673fa09ff13f2/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:07.689254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc897f-453c-4f02-82d2-351cd7827f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:07.690807 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc897f-453c-4f02-82d2-351cd7827f39 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.691220 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc897f-453c-4f02-82d2-351cd7827f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.691506 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc897f-453c-4f02-82d2-351cd7827f39 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.692742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc897f-453c-4f02-82d2-351cd7827f39 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:07.695344 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc897f-453c-4f02-82d2-351cd7827f39 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:07.697561 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 69/131] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:07 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:07.705115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee98379-1e6f-4e32-9cb4-00391545280d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:07.716793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee98379-1e6f-4e32-9cb4-00391545280d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:07.722655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1376ad-4a9d-4f11-abbf-6e5b4401bedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:07.723724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1376ad-4a9d-4f11-abbf-6e5b4401bedd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:07.724171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1376ad-4a9d-4f11-abbf-6e5b4401bedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:07.724638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1376ad-4a9d-4f11-abbf-6e5b4401bedd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:07.725697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1376ad-4a9d-4f11-abbf-6e5b4401bedd admin admin] RBAC: Adding query filter params (role.id=ac14076037e141cc9378a1773da23f3e, scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b, user.id=428f2d45101e44c4a85e0b2fe4ff7672) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:07.726173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1376ad-4a9d-4f11-abbf-6e5b4401bedd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:07.728373 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1376ad-4a9d-4f11-abbf-6e5b4401bedd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:07.738102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 63/132] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:07 2021] GET /identity/v3/role_assignments?user.id=428f2d45101e44c4a85e0b2fe4ff7672&scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b&role.id=ac14076037e141cc9378a1773da23f3e => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:08.132605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0dc26-799c-47bd-a9e1-f7b5223a173a None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:08.132790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0dc26-799c-47bd-a9e1-f7b5223a173a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:08.133077 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0dc26-799c-47bd-a9e1-f7b5223a173a None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:08.134890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 70/133] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:08.140732 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14efcef-44f5-4dc5-a35a-a3a18845fc10 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:08.141270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14efcef-44f5-4dc5-a35a-a3a18845fc10 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:08.141799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14efcef-44f5-4dc5-a35a-a3a18845fc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:08.168077 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-f14efcef-44f5-4dc5-a35a-a3a18845fc10 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:08.169583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f14efcef-44f5-4dc5-a35a-a3a18845fc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:08.178769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 64/134] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:08.210888 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0dc26-799c-47bd-a9e1-f7b5223a173a None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:08.228144 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0dc26-799c-47bd-a9e1-f7b5223a173a None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:08.238814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86543a62-1681-4aa9-a56b-7474574ab361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:08.239616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86543a62-1681-4aa9-a56b-7474574ab361 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:08.239899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86543a62-1681-4aa9-a56b-7474574ab361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:08.240177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86543a62-1681-4aa9-a56b-7474574ab361 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:08.241360 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86543a62-1681-4aa9-a56b-7474574ab361 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:08.243105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86543a62-1681-4aa9-a56b-7474574ab361 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:08.244919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 71/135] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:08.250720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14efcef-44f5-4dc5-a35a-a3a18845fc10 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:08.260472 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14efcef-44f5-4dc5-a35a-a3a18845fc10 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:08.271213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e29c86-e907-4e38-ab72-d08cf9a1d664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:08.272162 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e29c86-e907-4e38-ab72-d08cf9a1d664 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:08.272839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e29c86-e907-4e38-ab72-d08cf9a1d664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:08.273320 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e29c86-e907-4e38-ab72-d08cf9a1d664 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:08.274300 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e29c86-e907-4e38-ab72-d08cf9a1d664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:08.276488 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e29c86-e907-4e38-ab72-d08cf9a1d664 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:08.317938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 65/136] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:56:08 2021] POST /identity/v3/projects => generated 302 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:56:09.717955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b31a2-cf1b-4ee7-b6c9-fd1b7f7e18bc None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:09.718934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b31a2-cf1b-4ee7-b6c9-fd1b7f7e18bc None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:09.719449 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b31a2-cf1b-4ee7-b6c9-fd1b7f7e18bc None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:09.721743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 72/137] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:09.733737 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe1236-e3f0-4291-8403-b7d4d9cc1ac8 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:09.734177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe1236-e3f0-4291-8403-b7d4d9cc1ac8 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:09.734353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe1236-e3f0-4291-8403-b7d4d9cc1ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:09.763514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-07fe1236-e3f0-4291-8403-b7d4d9cc1ac8 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:09.764736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-07fe1236-e3f0-4291-8403-b7d4d9cc1ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:09.833829 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 66/138] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:09.878305 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b31a2-cf1b-4ee7-b6c9-fd1b7f7e18bc None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:09.896815 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b31a2-cf1b-4ee7-b6c9-fd1b7f7e18bc None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:09.906052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9838cc-5902-4d32-a70b-7e48bf65857d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:09.907181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9838cc-5902-4d32-a70b-7e48bf65857d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:09.907665 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9838cc-5902-4d32-a70b-7e48bf65857d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:09.908138 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9838cc-5902-4d32-a70b-7e48bf65857d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:09.919391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9838cc-5902-4d32-a70b-7e48bf65857d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:09.926956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-2c9838cc-5902-4d32-a70b-7e48bf65857d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:09.928493 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 73/139] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:09.935258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe1236-e3f0-4291-8403-b7d4d9cc1ac8 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:09.952991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe1236-e3f0-4291-8403-b7d4d9cc1ac8 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:09.959765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95cfaf-6bc7-4c03-95e3-eb22ba278817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:09.960805 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95cfaf-6bc7-4c03-95e3-eb22ba278817 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:09.961287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95cfaf-6bc7-4c03-95e3-eb22ba278817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:09.961754 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95cfaf-6bc7-4c03-95e3-eb22ba278817 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:09.962748 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95cfaf-6bc7-4c03-95e3-eb22ba278817 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:09.963274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95cfaf-6bc7-4c03-95e3-eb22ba278817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:09.965112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95cfaf-6bc7-4c03-95e3-eb22ba278817 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:09.978434 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 67/140] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:09.984607 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9838cc-5902-4d32-a70b-7e48bf65857d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:09.996112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9838cc-5902-4d32-a70b-7e48bf65857d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:10.001649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cc66c-b767-4586-a158-89fc31c88186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:10.003306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cc66c-b767-4586-a158-89fc31c88186 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.003790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cc66c-b767-4586-a158-89fc31c88186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.004256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cc66c-b767-4586-a158-89fc31c88186 admin admin] PATH_INFO: `/v3/users/614b9ecf23bd4252992673fa09ff13f2` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.005688 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cc66c-b767-4586-a158-89fc31c88186 admin admin] RBAC: Authorizing `identity:get_user(user_id=614b9ecf23bd4252992673fa09ff13f2)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:10.008098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cc66c-b767-4586-a158-89fc31c88186 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:10.014782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 74/141] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:09 2021] GET /identity/v3/users/614b9ecf23bd4252992673fa09ff13f2 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:10.020739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95cfaf-6bc7-4c03-95e3-eb22ba278817 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:10.031420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95cfaf-6bc7-4c03-95e3-eb22ba278817 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:10.039898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72eae9-afd3-414b-b94f-0a74030cc6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:10.040558 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72eae9-afd3-414b-b94f-0a74030cc6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.040850 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72eae9-afd3-414b-b94f-0a74030cc6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.041136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72eae9-afd3-414b-b94f-0a74030cc6f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.054320 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72eae9-afd3-414b-b94f-0a74030cc6f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:10.056129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72eae9-afd3-414b-b94f-0a74030cc6f3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:10.070357 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 68/142] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:10.076586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cc66c-b767-4586-a158-89fc31c88186 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:10.091483 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cc66c-b767-4586-a158-89fc31c88186 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:10.101903 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc953bdb-924e-444a-95f6-430746dd1065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:10.103047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc953bdb-924e-444a-95f6-430746dd1065 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.103531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc953bdb-924e-444a-95f6-430746dd1065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.104020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc953bdb-924e-444a-95f6-430746dd1065 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.105422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc953bdb-924e-444a-95f6-430746dd1065 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:10.107707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc953bdb-924e-444a-95f6-430746dd1065 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:10.109584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 75/143] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:10 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:10.116553 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72eae9-afd3-414b-b94f-0a74030cc6f3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:10.127280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72eae9-afd3-414b-b94f-0a74030cc6f3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:10.134531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5796962-2935-4b9b-8a19-273d701f9c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:10.135183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5796962-2935-4b9b-8a19-273d701f9c7c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.135473 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5796962-2935-4b9b-8a19-273d701f9c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.135759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5796962-2935-4b9b-8a19-273d701f9c7c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.136613 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5796962-2935-4b9b-8a19-273d701f9c7c admin admin] RBAC: Adding query filter params (role.id=800b8a36452a418b82e9e25cef933520, scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b, user.id=614b9ecf23bd4252992673fa09ff13f2) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:10.136931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5796962-2935-4b9b-8a19-273d701f9c7c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:10.142918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5796962-2935-4b9b-8a19-273d701f9c7c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:10.149782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 69/144] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:10 2021] GET /identity/v3/role_assignments?user.id=614b9ecf23bd4252992673fa09ff13f2&scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b&role.id=800b8a36452a418b82e9e25cef933520 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:10.416184 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b53c2-2e86-4330-9497-dc74107c97b4 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.416883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b53c2-2e86-4330-9497-dc74107c97b4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.417365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b53c2-2e86-4330-9497-dc74107c97b4 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.419767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 76/145] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:10.432789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7aaea-836a-40a7-aa59-25dbdfcd3d4d None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.433390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7aaea-836a-40a7-aa59-25dbdfcd3d4d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.433883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7aaea-836a-40a7-aa59-25dbdfcd3d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.454681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e0c7aaea-836a-40a7-aa59-25dbdfcd3d4d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:10.456798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e0c7aaea-836a-40a7-aa59-25dbdfcd3d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:10.468213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 70/146] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:10.507529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b53c2-2e86-4330-9497-dc74107c97b4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:10.523573 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b53c2-2e86-4330-9497-dc74107c97b4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:10.528245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef6458-78f1-4dd2-b1c0-a99a4e378e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:10.529271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef6458-78f1-4dd2-b1c0-a99a4e378e4a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.529730 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef6458-78f1-4dd2-b1c0-a99a4e378e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.530182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef6458-78f1-4dd2-b1c0-a99a4e378e4a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.548036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef6458-78f1-4dd2-b1c0-a99a4e378e4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:10.556529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-26ef6458-78f1-4dd2-b1c0-a99a4e378e4a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:10.558032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 77/147] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:10.564639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7aaea-836a-40a7-aa59-25dbdfcd3d4d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:10.574349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7aaea-836a-40a7-aa59-25dbdfcd3d4d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:10.582420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056249a8-265e-40b4-b081-b9e32fe596f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:10.583328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056249a8-265e-40b4-b081-b9e32fe596f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.583796 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056249a8-265e-40b4-b081-b9e32fe596f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.584240 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056249a8-265e-40b4-b081-b9e32fe596f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.585174 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056249a8-265e-40b4-b081-b9e32fe596f8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:10.585648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056249a8-265e-40b4-b081-b9e32fe596f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:10.587477 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056249a8-265e-40b4-b081-b9e32fe596f8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:10.596447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 71/148] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:10.602595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef6458-78f1-4dd2-b1c0-a99a4e378e4a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:10.614585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef6458-78f1-4dd2-b1c0-a99a4e378e4a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:10.621900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbf74d-e669-415a-a022-d12184d71dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:10.623022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbf74d-e669-415a-a022-d12184d71dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.623500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbf74d-e669-415a-a022-d12184d71dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.623938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbf74d-e669-415a-a022-d12184d71dc6 admin admin] PATH_INFO: `/v3/users/614b9ecf23bd4252992673fa09ff13f2` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.625362 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbf74d-e669-415a-a022-d12184d71dc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=614b9ecf23bd4252992673fa09ff13f2)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:10.627807 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbf74d-e669-415a-a022-d12184d71dc6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:10.629613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 78/149] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:10 2021] GET /identity/v3/users/614b9ecf23bd4252992673fa09ff13f2 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:10.635776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056249a8-265e-40b4-b081-b9e32fe596f8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:10.646309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056249a8-265e-40b4-b081-b9e32fe596f8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:10.653883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c7445-61d4-4351-b7a3-bfb8c5bed7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:10.654753 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c7445-61d4-4351-b7a3-bfb8c5bed7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.655232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c7445-61d4-4351-b7a3-bfb8c5bed7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.655680 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c7445-61d4-4351-b7a3-bfb8c5bed7f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.664821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c7445-61d4-4351-b7a3-bfb8c5bed7f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:10.666922 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c7445-61d4-4351-b7a3-bfb8c5bed7f3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:10.678329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 72/150] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:10.684607 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbf74d-e669-415a-a022-d12184d71dc6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:10.700831 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbf74d-e669-415a-a022-d12184d71dc6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:10.705992 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f41614-548c-4cf9-a7b6-49454faf93ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:10.707188 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f41614-548c-4cf9-a7b6-49454faf93ea admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.707647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f41614-548c-4cf9-a7b6-49454faf93ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.708121 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f41614-548c-4cf9-a7b6-49454faf93ea admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.709630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f41614-548c-4cf9-a7b6-49454faf93ea admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:10.711976 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f41614-548c-4cf9-a7b6-49454faf93ea admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:10.713966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 79/151] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:10 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:10.720569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c7445-61d4-4351-b7a3-bfb8c5bed7f3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:10.730418 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c7445-61d4-4351-b7a3-bfb8c5bed7f3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:10.735074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b6082-5d26-4685-8f26-b9903c0cc114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:10.736349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b6082-5d26-4685-8f26-b9903c0cc114 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.736799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b6082-5d26-4685-8f26-b9903c0cc114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.738057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b6082-5d26-4685-8f26-b9903c0cc114 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.739125 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b6082-5d26-4685-8f26-b9903c0cc114 admin admin] RBAC: Adding query filter params (role.id=1dbfc98083ce41ea943fbb3de6be133e, scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b, user.id=614b9ecf23bd4252992673fa09ff13f2) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:10.739619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b6082-5d26-4685-8f26-b9903c0cc114 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:10.741638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b6082-5d26-4685-8f26-b9903c0cc114 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:10.754014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 73/152] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:10 2021] GET /identity/v3/role_assignments?user.id=614b9ecf23bd4252992673fa09ff13f2&scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b&role.id=1dbfc98083ce41ea943fbb3de6be133e => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:10.942605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2489a5c-9cb5-4292-bb4c-26fd9fef659b None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.943460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2489a5c-9cb5-4292-bb4c-26fd9fef659b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.943914 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2489a5c-9cb5-4292-bb4c-26fd9fef659b None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.946237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 80/153] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:10.954248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6055dce-ce53-4a6c-b1e0-45f7c9841101 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:10.954917 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6055dce-ce53-4a6c-b1e0-45f7c9841101 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:10.955374 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6055dce-ce53-4a6c-b1e0-45f7c9841101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:10.980164 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e6055dce-ce53-4a6c-b1e0-45f7c9841101 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:10.981673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e6055dce-ce53-4a6c-b1e0-45f7c9841101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:10.992463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 74/154] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:11.038871 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2489a5c-9cb5-4292-bb4c-26fd9fef659b None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.056514 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2489a5c-9cb5-4292-bb4c-26fd9fef659b None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.061112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0549d-9bb6-4409-a236-a0ea8f1eb63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.062100 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0549d-9bb6-4409-a236-a0ea8f1eb63f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.062579 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0549d-9bb6-4409-a236-a0ea8f1eb63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.063044 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0549d-9bb6-4409-a236-a0ea8f1eb63f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.081909 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0549d-9bb6-4409-a236-a0ea8f1eb63f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:11.089118 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-5ba0549d-9bb6-4409-a236-a0ea8f1eb63f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:56:11.090876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 81/155] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:11.097225 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6055dce-ce53-4a6c-b1e0-45f7c9841101 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.111337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6055dce-ce53-4a6c-b1e0-45f7c9841101 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.116874 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d5d1b-b42a-44af-be45-1b94f58afa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.117751 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d5d1b-b42a-44af-be45-1b94f58afa7e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.118206 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d5d1b-b42a-44af-be45-1b94f58afa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.118666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d5d1b-b42a-44af-be45-1b94f58afa7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.119698 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d5d1b-b42a-44af-be45-1b94f58afa7e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:11.120181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d5d1b-b42a-44af-be45-1b94f58afa7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.121963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d5d1b-b42a-44af-be45-1b94f58afa7e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.136427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 75/156] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:11.142332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0549d-9bb6-4409-a236-a0ea8f1eb63f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.156767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0549d-9bb6-4409-a236-a0ea8f1eb63f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.170256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e4b60-872f-434e-8a5c-4caf784f0045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.171441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e4b60-872f-434e-8a5c-4caf784f0045 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.171893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e4b60-872f-434e-8a5c-4caf784f0045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.172334 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e4b60-872f-434e-8a5c-4caf784f0045 admin admin] PATH_INFO: `/v3/users/9a491d369dd94708903d971f130743aa` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.173733 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e4b60-872f-434e-8a5c-4caf784f0045 admin admin] RBAC: Authorizing `identity:get_user(user_id=9a491d369dd94708903d971f130743aa)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.176355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e4b60-872f-434e-8a5c-4caf784f0045 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.178218 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 82/157] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/users/9a491d369dd94708903d971f130743aa => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:11.184457 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d5d1b-b42a-44af-be45-1b94f58afa7e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.201752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d5d1b-b42a-44af-be45-1b94f58afa7e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.207117 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46e4f2-d377-4c15-9f05-4b521881fdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.207812 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46e4f2-d377-4c15-9f05-4b521881fdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.208105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46e4f2-d377-4c15-9f05-4b521881fdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.208382 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46e4f2-d377-4c15-9f05-4b521881fdf4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.217659 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46e4f2-d377-4c15-9f05-4b521881fdf4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.219680 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46e4f2-d377-4c15-9f05-4b521881fdf4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.230950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 76/158] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:11.236596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e4b60-872f-434e-8a5c-4caf784f0045 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.251783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e4b60-872f-434e-8a5c-4caf784f0045 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.256639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a90f9-33c7-4cdf-b21d-679461346e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.257759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a90f9-33c7-4cdf-b21d-679461346e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.258233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a90f9-33c7-4cdf-b21d-679461346e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.258725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a90f9-33c7-4cdf-b21d-679461346e88 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.260110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a90f9-33c7-4cdf-b21d-679461346e88 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.262406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a90f9-33c7-4cdf-b21d-679461346e88 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.264303 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 83/159] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:11.272123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46e4f2-d377-4c15-9f05-4b521881fdf4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.283613 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46e4f2-d377-4c15-9f05-4b521881fdf4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.289287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bdebf-23e3-4903-97cc-c3344feb7027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.289945 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bdebf-23e3-4903-97cc-c3344feb7027 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.291080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bdebf-23e3-4903-97cc-c3344feb7027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.291080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bdebf-23e3-4903-97cc-c3344feb7027 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.291420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bdebf-23e3-4903-97cc-c3344feb7027 admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b, user.id=9a491d369dd94708903d971f130743aa) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:11.291675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bdebf-23e3-4903-97cc-c3344feb7027 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.293546 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bdebf-23e3-4903-97cc-c3344feb7027 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.302486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 77/160] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/role_assignments?user.id=9a491d369dd94708903d971f130743aa&scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:11.345185 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11940276-51c1-48b2-8ecc-105b2916a4b4 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.345818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11940276-51c1-48b2-8ecc-105b2916a4b4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.346405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11940276-51c1-48b2-8ecc-105b2916a4b4 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.349555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 84/161] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:11.356198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd716cc3-2377-42fa-bfb3-9aee8ff9a3c5 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.357406 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd716cc3-2377-42fa-bfb3-9aee8ff9a3c5 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.357406 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd716cc3-2377-42fa-bfb3-9aee8ff9a3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.381970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-bd716cc3-2377-42fa-bfb3-9aee8ff9a3c5 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:11.383601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-bd716cc3-2377-42fa-bfb3-9aee8ff9a3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:11.396401 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 78/162] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:11.422604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11940276-51c1-48b2-8ecc-105b2916a4b4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.444613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11940276-51c1-48b2-8ecc-105b2916a4b4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.452726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddce11-9e39-455c-899f-0424115f45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.453466 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddce11-9e39-455c-899f-0424115f45e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.453751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddce11-9e39-455c-899f-0424115f45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.454027 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddce11-9e39-455c-899f-0424115f45e1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.469182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddce11-9e39-455c-899f-0424115f45e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:11.477929 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-79ddce11-9e39-455c-899f-0424115f45e1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:11.479521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 85/163] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:11.485836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd716cc3-2377-42fa-bfb3-9aee8ff9a3c5 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.496797 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd716cc3-2377-42fa-bfb3-9aee8ff9a3c5 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.505218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10395c05-e44e-4fda-ba67-34c1a30c4318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.505979 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10395c05-e44e-4fda-ba67-34c1a30c4318 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.506265 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10395c05-e44e-4fda-ba67-34c1a30c4318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.506630 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10395c05-e44e-4fda-ba67-34c1a30c4318 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.507439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10395c05-e44e-4fda-ba67-34c1a30c4318 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:11.507748 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10395c05-e44e-4fda-ba67-34c1a30c4318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.512054 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10395c05-e44e-4fda-ba67-34c1a30c4318 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.522728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9290-76f5-4213-b0f3-14a3575f386d None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.523397 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9290-76f5-4213-b0f3-14a3575f386d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.523671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 79/164] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:11.524083 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9290-76f5-4213-b0f3-14a3575f386d None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.526382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 86/165] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:11 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:11.529944 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10395c05-e44e-4fda-ba67-34c1a30c4318 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.533290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d322c8f-0c1e-4efa-9839-ff01b9335eeb None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.534590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d322c8f-0c1e-4efa-9839-ff01b9335eeb None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.535273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d322c8f-0c1e-4efa-9839-ff01b9335eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.546055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10395c05-e44e-4fda-ba67-34c1a30c4318 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.559167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f09461-5f3c-4bbf-b1b7-ad3fa0704b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.561405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f09461-5f3c-4bbf-b1b7-ad3fa0704b52 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.561405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f09461-5f3c-4bbf-b1b7-ad3fa0704b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.561405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f09461-5f3c-4bbf-b1b7-ad3fa0704b52 admin admin] PATH_INFO: `/v3/users/614b9ecf23bd4252992673fa09ff13f2` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.566019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f09461-5f3c-4bbf-b1b7-ad3fa0704b52 admin admin] RBAC: Authorizing `identity:get_user(user_id=614b9ecf23bd4252992673fa09ff13f2)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.568454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f09461-5f3c-4bbf-b1b7-ad3fa0704b52 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.568698 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9d322c8f-0c1e-4efa-9839-ff01b9335eeb None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:11.570319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9d322c8f-0c1e-4efa-9839-ff01b9335eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:11.570698 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 80/166] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/users/614b9ecf23bd4252992673fa09ff13f2 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:11.578783 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f09461-5f3c-4bbf-b1b7-ad3fa0704b52 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.590245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 87/167] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:11.591061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f09461-5f3c-4bbf-b1b7-ad3fa0704b52 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.600220 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7840-3c60-4c4c-ad29-a5c300377fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.601181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7840-3c60-4c4c-ad29-a5c300377fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.601602 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7840-3c60-4c4c-ad29-a5c300377fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.602100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7840-3c60-4c4c-ad29-a5c300377fa8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.613819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7840-3c60-4c4c-ad29-a5c300377fa8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.615948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7840-3c60-4c4c-ad29-a5c300377fa8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.618463 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d322c8f-0c1e-4efa-9839-ff01b9335eeb None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.626916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 81/168] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:11.630444 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d322c8f-0c1e-4efa-9839-ff01b9335eeb None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.634553 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7840-3c60-4c4c-ad29-a5c300377fa8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.636994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19064d12-7728-4ed3-9cd5-e50b1bf8954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.638062 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19064d12-7728-4ed3-9cd5-e50b1bf8954a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.638561 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19064d12-7728-4ed3-9cd5-e50b1bf8954a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.639114 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19064d12-7728-4ed3-9cd5-e50b1bf8954a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.648231 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7840-3c60-4c4c-ad29-a5c300377fa8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.655788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19064d12-7728-4ed3-9cd5-e50b1bf8954a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:11.660948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1360168-2d42-4c00-8fb0-2220f293cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.661424 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1360168-2d42-4c00-8fb0-2220f293cfbc admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.661700 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1360168-2d42-4c00-8fb0-2220f293cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.661988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1360168-2d42-4c00-8fb0-2220f293cfbc admin admin] PATH_INFO: `/v3/projects/bbf2319f60534d6dae250989069a87c3` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.663702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1360168-2d42-4c00-8fb0-2220f293cfbc admin admin] RBAC: Authorizing `identity:get_project(project_id=bbf2319f60534d6dae250989069a87c3)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.664029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-19064d12-7728-4ed3-9cd5-e50b1bf8954a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 09 00:56:11.665421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 88/169] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:11.667030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1360168-2d42-4c00-8fb0-2220f293cfbc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.668776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 82/170] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/projects/bbf2319f60534d6dae250989069a87c3 => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:11.675736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1360168-2d42-4c00-8fb0-2220f293cfbc admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.675893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19064d12-7728-4ed3-9cd5-e50b1bf8954a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.686848 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19064d12-7728-4ed3-9cd5-e50b1bf8954a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.687549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1360168-2d42-4c00-8fb0-2220f293cfbc admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.692650 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13b999-854c-495e-97d5-8f76c9d1a198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.693341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13b999-854c-495e-97d5-8f76c9d1a198 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.693620 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13b999-854c-495e-97d5-8f76c9d1a198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.693718 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6ad14-e682-4f47-9c73-f6a3253eea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.693894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13b999-854c-495e-97d5-8f76c9d1a198 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.694615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6ad14-e682-4f47-9c73-f6a3253eea5e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.694827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13b999-854c-495e-97d5-8f76c9d1a198 admin admin] RBAC: Adding query filter params (role.id=800b8a36452a418b82e9e25cef933520, scope.project.id=bbf2319f60534d6dae250989069a87c3, user.id=614b9ecf23bd4252992673fa09ff13f2) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:11.695154 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13b999-854c-495e-97d5-8f76c9d1a198 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.695594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6ad14-e682-4f47-9c73-f6a3253eea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.696119 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6ad14-e682-4f47-9c73-f6a3253eea5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.697584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6ad14-e682-4f47-9c73-f6a3253eea5e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:11.697915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13b999-854c-495e-97d5-8f76c9d1a198 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.698328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6ad14-e682-4f47-9c73-f6a3253eea5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.700090 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6ad14-e682-4f47-9c73-f6a3253eea5e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.712197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 89/171] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/role_assignments?user.id=614b9ecf23bd4252992673fa09ff13f2&scope.project.id=bbf2319f60534d6dae250989069a87c3&role.id=800b8a36452a418b82e9e25cef933520 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:11.715528 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 83/172] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:11.724811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13b999-854c-495e-97d5-8f76c9d1a198 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.737906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13b999-854c-495e-97d5-8f76c9d1a198 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.743878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11948b5-cd4f-4fea-9f8d-81f423b6c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.744778 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11948b5-cd4f-4fea-9f8d-81f423b6c947 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.745057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11948b5-cd4f-4fea-9f8d-81f423b6c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.745331 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11948b5-cd4f-4fea-9f8d-81f423b6c947 admin admin] PATH_INFO: `/v3/users/428f2d45101e44c4a85e0b2fe4ff7672` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.746682 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11948b5-cd4f-4fea-9f8d-81f423b6c947 admin admin] RBAC: Authorizing `identity:get_user(user_id=428f2d45101e44c4a85e0b2fe4ff7672)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.748996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11948b5-cd4f-4fea-9f8d-81f423b6c947 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.750988 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 90/173] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/users/428f2d45101e44c4a85e0b2fe4ff7672 => generated 289 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:11.757340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6ad14-e682-4f47-9c73-f6a3253eea5e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.768416 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6ad14-e682-4f47-9c73-f6a3253eea5e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.773123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57168023-10f8-4c42-88e2-71f8e323c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.774105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57168023-10f8-4c42-88e2-71f8e323c56e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.774661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57168023-10f8-4c42-88e2-71f8e323c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.775032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57168023-10f8-4c42-88e2-71f8e323c56e admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.776817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57168023-10f8-4c42-88e2-71f8e323c56e admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.779436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57168023-10f8-4c42-88e2-71f8e323c56e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.782414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 84/174] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:11 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:11.790056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11948b5-cd4f-4fea-9f8d-81f423b6c947 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:11.801221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11948b5-cd4f-4fea-9f8d-81f423b6c947 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:11.805904 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7e64c-04b9-4887-97d9-568133e2aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:11.806988 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e64c-04b9-4887-97d9-568133e2aacb admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:11.807326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e64c-04b9-4887-97d9-568133e2aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:11.807675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e64c-04b9-4887-97d9-568133e2aacb admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b/users/428f2d45101e44c4a85e0b2fe4ff7672/roles/ac14076037e141cc9378a1773da23f3e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:11.809906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7e64c-04b9-4887-97d9-568133e2aacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbc52dd5f424931a362b9a5e7697c8b, user_id=428f2d45101e44c4a85e0b2fe4ff7672, role_id=ac14076037e141cc9378a1773da23f3e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:11.812789 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7e64c-04b9-4887-97d9-568133e2aacb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:11.827910 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 91/175] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:11 2021] PUT /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b/users/428f2d45101e44c4a85e0b2fe4ff7672/roles/ac14076037e141cc9378a1773da23f3e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 00:56:12.166173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a36825-2caa-4156-bbe1-209fe153d953 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:12.166488 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a36825-2caa-4156-bbe1-209fe153d953 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:12.166765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a36825-2caa-4156-bbe1-209fe153d953 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:12.168554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 85/176] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:12.183082 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804581b-c8db-4649-b86c-e5cca5434296 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:12.183548 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804581b-c8db-4649-b86c-e5cca5434296 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:12.183629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804581b-c8db-4649-b86c-e5cca5434296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:12.201124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d804581b-c8db-4649-b86c-e5cca5434296 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:12.202316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d804581b-c8db-4649-b86c-e5cca5434296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:12.258088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 92/177] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:12.283269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a36825-2caa-4156-bbe1-209fe153d953 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:12.295821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a36825-2caa-4156-bbe1-209fe153d953 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:12.300539 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e6188-9fee-4a41-bbf9-120c6c9578df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:12.301308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e6188-9fee-4a41-bbf9-120c6c9578df admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:12.301587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e6188-9fee-4a41-bbf9-120c6c9578df admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:12.301858 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e6188-9fee-4a41-bbf9-120c6c9578df admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:12.303024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e6188-9fee-4a41-bbf9-120c6c9578df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:12.304691 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e6188-9fee-4a41-bbf9-120c6c9578df admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:12.306443 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 86/178] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:12.311980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804581b-c8db-4649-b86c-e5cca5434296 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:12.320973 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804581b-c8db-4649-b86c-e5cca5434296 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:12.325222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb920857-3dae-45cb-a776-62768c778f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:12.325874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb920857-3dae-45cb-a776-62768c778f94 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:12.326152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb920857-3dae-45cb-a776-62768c778f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:12.326455 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb920857-3dae-45cb-a776-62768c778f94 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:12.327177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb920857-3dae-45cb-a776-62768c778f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:12.329124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb920857-3dae-45cb-a776-62768c778f94 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:12.349155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 93/179] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:56:12 2021] POST /identity/v3/users => generated 283 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:56:14.262049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cbc3d-cf38-429b-be15-399175c7dff5 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.263023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cbc3d-cf38-429b-be15-399175c7dff5 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.263501 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cbc3d-cf38-429b-be15-399175c7dff5 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:14.265698 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 87/180] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:14.272246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e60564-727f-48ec-be14-ceb8034348eb None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.273053 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e60564-727f-48ec-be14-ceb8034348eb None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.273521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e60564-727f-48ec-be14-ceb8034348eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:14.291898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-b1e60564-727f-48ec-be14-ceb8034348eb None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:14.293408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b1e60564-727f-48ec-be14-ceb8034348eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:14.301718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 94/181] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:14.325946 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cbc3d-cf38-429b-be15-399175c7dff5 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:14.340624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cbc3d-cf38-429b-be15-399175c7dff5 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:14.345668 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e169a3-01d5-4588-b58c-1aee07d3dcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:14.346969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e169a3-01d5-4588-b58c-1aee07d3dcdd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.347533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e169a3-01d5-4588-b58c-1aee07d3dcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.347999 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e169a3-01d5-4588-b58c-1aee07d3dcdd admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:14.359394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e169a3-01d5-4588-b58c-1aee07d3dcdd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:14.367548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-b5e169a3-01d5-4588-b58c-1aee07d3dcdd admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 09 00:56:14.369272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 88/182] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:14 2021] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:14.375629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e60564-727f-48ec-be14-ceb8034348eb None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:14.385705 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e60564-727f-48ec-be14-ceb8034348eb None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:14.390460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac6b48-c823-4101-a0bd-e5089761063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:14.391343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac6b48-c823-4101-a0bd-e5089761063c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.391816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac6b48-c823-4101-a0bd-e5089761063c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.392296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac6b48-c823-4101-a0bd-e5089761063c admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:14.393291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac6b48-c823-4101-a0bd-e5089761063c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:14.393966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac6b48-c823-4101-a0bd-e5089761063c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:14.395815 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac6b48-c823-4101-a0bd-e5089761063c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:14.405116 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 95/183] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:14 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:14.412157 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e169a3-01d5-4588-b58c-1aee07d3dcdd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:14.422781 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e169a3-01d5-4588-b58c-1aee07d3dcdd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:14.428351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc4050-f5b1-4432-8def-555d17ff4127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:14.429584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc4050-f5b1-4432-8def-555d17ff4127 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.430062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc4050-f5b1-4432-8def-555d17ff4127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.430587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc4050-f5b1-4432-8def-555d17ff4127 admin admin] PATH_INFO: `/v3/users/428f2d45101e44c4a85e0b2fe4ff7672` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:14.432159 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc4050-f5b1-4432-8def-555d17ff4127 admin admin] RBAC: Authorizing `identity:get_user(user_id=428f2d45101e44c4a85e0b2fe4ff7672)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:14.434627 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc4050-f5b1-4432-8def-555d17ff4127 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:14.437003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 89/184] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:14 2021] GET /identity/v3/users/428f2d45101e44c4a85e0b2fe4ff7672 => generated 289 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:14.443578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac6b48-c823-4101-a0bd-e5089761063c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:14.453957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac6b48-c823-4101-a0bd-e5089761063c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:14.458977 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaedea8-e065-4c24-8c1a-082797663c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:14.459685 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaedea8-e065-4c24-8c1a-082797663c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.459998 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaedea8-e065-4c24-8c1a-082797663c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.460273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaedea8-e065-4c24-8c1a-082797663c8d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:14.469401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaedea8-e065-4c24-8c1a-082797663c8d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:14.471691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaedea8-e065-4c24-8c1a-082797663c8d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:14.480555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 96/185] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:14 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:14.486554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc4050-f5b1-4432-8def-555d17ff4127 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:14.496587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc4050-f5b1-4432-8def-555d17ff4127 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:14.500965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf53b9-49cc-4db3-a4aa-890ea51dd61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:14.501806 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf53b9-49cc-4db3-a4aa-890ea51dd61b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.502084 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf53b9-49cc-4db3-a4aa-890ea51dd61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.502359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf53b9-49cc-4db3-a4aa-890ea51dd61b admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:14.504331 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf53b9-49cc-4db3-a4aa-890ea51dd61b admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:14.506397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf53b9-49cc-4db3-a4aa-890ea51dd61b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:14.508238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 90/186] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:14 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:14.514329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaedea8-e065-4c24-8c1a-082797663c8d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:14.523405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaedea8-e065-4c24-8c1a-082797663c8d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:14.527840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e61f9-5e85-4389-b034-b03fe33352e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:14.528477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e61f9-5e85-4389-b034-b03fe33352e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.528755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e61f9-5e85-4389-b034-b03fe33352e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.529023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e61f9-5e85-4389-b034-b03fe33352e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:14.529853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e61f9-5e85-4389-b034-b03fe33352e3 admin admin] RBAC: Adding query filter params (role.id=ac14076037e141cc9378a1773da23f3e, scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b, user.id=428f2d45101e44c4a85e0b2fe4ff7672) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:14.530158 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e61f9-5e85-4389-b034-b03fe33352e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:14.532026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e61f9-5e85-4389-b034-b03fe33352e3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:14.539184 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 97/187] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:14 2021] GET /identity/v3/role_assignments?user.id=428f2d45101e44c4a85e0b2fe4ff7672&scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b&role.id=ac14076037e141cc9378a1773da23f3e => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:14.836847 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05932d9-4360-4217-bc31-b14f2af93cd0 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.837214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05932d9-4360-4217-bc31-b14f2af93cd0 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.837403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05932d9-4360-4217-bc31-b14f2af93cd0 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:14.842811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 91/188] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:14.851344 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76790-36b9-4d77-bba9-0b53717a44d4 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.851631 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76790-36b9-4d77-bba9-0b53717a44d4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.851904 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76790-36b9-4d77-bba9-0b53717a44d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:14.869441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-66d76790-36b9-4d77-bba9-0b53717a44d4 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:14.870630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-66d76790-36b9-4d77-bba9-0b53717a44d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:14.878048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 98/189] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:14.901950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05932d9-4360-4217-bc31-b14f2af93cd0 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:14.914314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05932d9-4360-4217-bc31-b14f2af93cd0 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:14.918438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c82df-c622-49b9-a19b-62af2a6e7353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:14.919218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c82df-c622-49b9-a19b-62af2a6e7353 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.919496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c82df-c622-49b9-a19b-62af2a6e7353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.919768 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c82df-c622-49b9-a19b-62af2a6e7353 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:14.930058 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c82df-c622-49b9-a19b-62af2a6e7353 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:14.936983 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-823c82df-c622-49b9-a19b-62af2a6e7353 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:56:14.938314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 92/190] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:56:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:14.944475 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76790-36b9-4d77-bba9-0b53717a44d4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:14.953264 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76790-36b9-4d77-bba9-0b53717a44d4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:14.958557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faeb47-6d8e-4f34-aef6-bb6845a365e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:14.959211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faeb47-6d8e-4f34-aef6-bb6845a365e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.959486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faeb47-6d8e-4f34-aef6-bb6845a365e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.959755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faeb47-6d8e-4f34-aef6-bb6845a365e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:14.960500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faeb47-6d8e-4f34-aef6-bb6845a365e5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:14.960801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faeb47-6d8e-4f34-aef6-bb6845a365e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:14.962393 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faeb47-6d8e-4f34-aef6-bb6845a365e5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:14.970790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 99/191] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:14.976499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c82df-c622-49b9-a19b-62af2a6e7353 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:14.986598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c82df-c622-49b9-a19b-62af2a6e7353 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:14.991987 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0113b1-f1f4-438c-a543-57121f9fb1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:14.992830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0113b1-f1f4-438c-a543-57121f9fb1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:14.993103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0113b1-f1f4-438c-a543-57121f9fb1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:14.993369 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0113b1-f1f4-438c-a543-57121f9fb1b3 admin admin] PATH_INFO: `/v3/users/15a13f27549f41b3be9714baa3808f8a` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.006537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0113b1-f1f4-438c-a543-57121f9fb1b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=15a13f27549f41b3be9714baa3808f8a)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:15.008673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0113b1-f1f4-438c-a543-57121f9fb1b3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:15.010578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 93/192] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:14 2021] GET /identity/v3/users/15a13f27549f41b3be9714baa3808f8a => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:15.016297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faeb47-6d8e-4f34-aef6-bb6845a365e5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:15.027015 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faeb47-6d8e-4f34-aef6-bb6845a365e5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:15.031385 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9b38d-fdd4-4e23-a3b5-4cff2422e942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:15.032107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9b38d-fdd4-4e23-a3b5-4cff2422e942 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.032458 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9b38d-fdd4-4e23-a3b5-4cff2422e942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.032805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9b38d-fdd4-4e23-a3b5-4cff2422e942 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.042047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9b38d-fdd4-4e23-a3b5-4cff2422e942 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:15.043835 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9b38d-fdd4-4e23-a3b5-4cff2422e942 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:15.049129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae100c6-68b5-483b-a520-0c0f7aa814f7 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.049471 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae100c6-68b5-483b-a520-0c0f7aa814f7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.049752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae100c6-68b5-483b-a520-0c0f7aa814f7 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.051692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 94/193] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:15.058246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 100/194] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:15 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 09 00:56:15.058386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2a70-70a9-4696-92ef-2afbc334a049 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.058386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2a70-70a9-4696-92ef-2afbc334a049 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.058386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2a70-70a9-4696-92ef-2afbc334a049 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.058386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 95/195] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:15.058644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586349c-2bb3-4e80-a437-e16247ecceda None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.058644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586349c-2bb3-4e80-a437-e16247ecceda None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.058848 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586349c-2bb3-4e80-a437-e16247ecceda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.059068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c2a70-70a9-4696-92ef-2afbc334a049 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:15.071166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c2a70-70a9-4696-92ef-2afbc334a049 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:15.075299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbb4a2-9470-4933-9bc6-ae8462bc1885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:15.076094 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbb4a2-9470-4933-9bc6-ae8462bc1885 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.076360 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9586349c-2bb3-4e80-a437-e16247ecceda None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:15.076454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbb4a2-9470-4933-9bc6-ae8462bc1885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.076641 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbb4a2-9470-4933-9bc6-ae8462bc1885 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.077554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9586349c-2bb3-4e80-a437-e16247ecceda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:15.077804 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbb4a2-9470-4933-9bc6-ae8462bc1885 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:15.079874 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbb4a2-9470-4933-9bc6-ae8462bc1885 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:15.082616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 96/196] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:15 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:15.087835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b7486-c2eb-43fc-975c-f4106d28f32a None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.087835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b7486-c2eb-43fc-975c-f4106d28f32a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.087835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b7486-c2eb-43fc-975c-f4106d28f32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.090279 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 101/197] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:15.090954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586349c-2bb3-4e80-a437-e16247ecceda None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:15.100797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586349c-2bb3-4e80-a437-e16247ecceda None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:15.104806 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-bc1b7486-c2eb-43fc-975c-f4106d28f32a None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:15.105017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5113fc-fa07-430e-847e-6928ccd73191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:15.105640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5113fc-fa07-430e-847e-6928ccd73191 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.105919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5113fc-fa07-430e-847e-6928ccd73191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.106013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-bc1b7486-c2eb-43fc-975c-f4106d28f32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:15.106192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5113fc-fa07-430e-847e-6928ccd73191 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.107052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5113fc-fa07-430e-847e-6928ccd73191 admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=c97292c93fce46b1bf851f877c9530ff, user.id=15a13f27549f41b3be9714baa3808f8a) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:15.107362 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5113fc-fa07-430e-847e-6928ccd73191 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:15.109188 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5113fc-fa07-430e-847e-6928ccd73191 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:15.114653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 97/198] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:15.122601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 102/199] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:15 2021] GET /identity/v3/role_assignments?user.id=15a13f27549f41b3be9714baa3808f8a&scope.project.id=c97292c93fce46b1bf851f877c9530ff&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:15.122784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b7486-c2eb-43fc-975c-f4106d28f32a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:15.129579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b7486-c2eb-43fc-975c-f4106d28f32a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:15.134109 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe1a1c-7b10-4c57-b810-ec1ade01de69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:15.134969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe1a1c-7b10-4c57-b810-ec1ade01de69 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.135257 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe1a1c-7b10-4c57-b810-ec1ade01de69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.135536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe1a1c-7b10-4c57-b810-ec1ade01de69 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.136811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe1a1c-7b10-4c57-b810-ec1ade01de69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:15.138706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe1a1c-7b10-4c57-b810-ec1ade01de69 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:15.139520 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5113fc-fa07-430e-847e-6928ccd73191 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:15.140414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 98/200] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:15.147662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe1a1c-7b10-4c57-b810-ec1ade01de69 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:15.151286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5113fc-fa07-430e-847e-6928ccd73191 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:15.155803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b7d1f-7ccb-4a7c-9f6a-557481d96762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:15.156625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b7d1f-7ccb-4a7c-9f6a-557481d96762 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.156910 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b7d1f-7ccb-4a7c-9f6a-557481d96762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.157187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b7d1f-7ccb-4a7c-9f6a-557481d96762 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.157538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe1a1c-7b10-4c57-b810-ec1ade01de69 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:15.163664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75203cfe-ed1f-48a8-bacf-61843a157dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:15.164393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75203cfe-ed1f-48a8-bacf-61843a157dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.164678 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75203cfe-ed1f-48a8-bacf-61843a157dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.164956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75203cfe-ed1f-48a8-bacf-61843a157dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.165907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75203cfe-ed1f-48a8-bacf-61843a157dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:15.167887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75203cfe-ed1f-48a8-bacf-61843a157dd4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:15.171225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b7d1f-7ccb-4a7c-9f6a-557481d96762 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:15.181480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-bf2b7d1f-7ccb-4a7c-9f6a-557481d96762 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:15.183281 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 103/201] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:15.190777 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b7d1f-7ccb-4a7c-9f6a-557481d96762 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:15.194416 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 99/202] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:56:15 2021] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:56:15.205397 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b7d1f-7ccb-4a7c-9f6a-557481d96762 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:15.210566 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837b4c8-935d-4542-82a1-2e4d338ca112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:15.211313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837b4c8-935d-4542-82a1-2e4d338ca112 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.211650 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837b4c8-935d-4542-82a1-2e4d338ca112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.211929 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837b4c8-935d-4542-82a1-2e4d338ca112 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.212725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837b4c8-935d-4542-82a1-2e4d338ca112 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:15.213034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837b4c8-935d-4542-82a1-2e4d338ca112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:15.214765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837b4c8-935d-4542-82a1-2e4d338ca112 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:15.226554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 104/203] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:15.232470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75203cfe-ed1f-48a8-bacf-61843a157dd4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:15.243743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75203cfe-ed1f-48a8-bacf-61843a157dd4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:15.248269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a75bb6-d544-4634-8023-daef487f737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:15.249181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a75bb6-d544-4634-8023-daef487f737c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.249460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a75bb6-d544-4634-8023-daef487f737c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.249735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a75bb6-d544-4634-8023-daef487f737c admin admin] PATH_INFO: `/v3/users/15a13f27549f41b3be9714baa3808f8a` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.251162 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a75bb6-d544-4634-8023-daef487f737c admin admin] RBAC: Authorizing `identity:get_user(user_id=15a13f27549f41b3be9714baa3808f8a)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:15.253674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a75bb6-d544-4634-8023-daef487f737c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:15.255861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 100/204] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:15 2021] GET /identity/v3/users/15a13f27549f41b3be9714baa3808f8a => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:15.262080 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837b4c8-935d-4542-82a1-2e4d338ca112 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:15.272465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837b4c8-935d-4542-82a1-2e4d338ca112 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:15.277063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab37b0-253c-49b8-ae0d-eb8f9ae2e78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:15.277839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab37b0-253c-49b8-ae0d-eb8f9ae2e78a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.278212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab37b0-253c-49b8-ae0d-eb8f9ae2e78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.278589 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab37b0-253c-49b8-ae0d-eb8f9ae2e78a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.288421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab37b0-253c-49b8-ae0d-eb8f9ae2e78a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:15.290248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab37b0-253c-49b8-ae0d-eb8f9ae2e78a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:15.301511 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 105/205] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:15 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:15.307952 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a75bb6-d544-4634-8023-daef487f737c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:15.318508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a75bb6-d544-4634-8023-daef487f737c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:15.323406 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e8c87-e3d4-4398-8362-0510c6dce942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:15.324471 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e8c87-e3d4-4398-8362-0510c6dce942 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.324853 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e8c87-e3d4-4398-8362-0510c6dce942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.325227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e8c87-e3d4-4398-8362-0510c6dce942 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.327024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e8c87-e3d4-4398-8362-0510c6dce942 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:15.329317 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e8c87-e3d4-4398-8362-0510c6dce942 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:15.331625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 101/206] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:15 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:15.338465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab37b0-253c-49b8-ae0d-eb8f9ae2e78a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:15.349219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab37b0-253c-49b8-ae0d-eb8f9ae2e78a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:15.354297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eff78a-ce62-4348-8e2d-e71abbfb38b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:15.354648 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eff78a-ce62-4348-8e2d-e71abbfb38b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:15.354927 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eff78a-ce62-4348-8e2d-e71abbfb38b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:15.355199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eff78a-ce62-4348-8e2d-e71abbfb38b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:15.356057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eff78a-ce62-4348-8e2d-e71abbfb38b7 admin admin] RBAC: Adding query filter params (role.id=1dbfc98083ce41ea943fbb3de6be133e, scope.project.id=c97292c93fce46b1bf851f877c9530ff, user.id=15a13f27549f41b3be9714baa3808f8a) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:15.356366 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eff78a-ce62-4348-8e2d-e71abbfb38b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:15.358614 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eff78a-ce62-4348-8e2d-e71abbfb38b7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:15.366048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 106/207] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:15 2021] GET /identity/v3/role_assignments?user.id=15a13f27549f41b3be9714baa3808f8a&scope.project.id=c97292c93fce46b1bf851f877c9530ff&role.id=1dbfc98083ce41ea943fbb3de6be133e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:17.538501 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137dbaf-9811-4322-837e-839660a38be0 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.539343 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137dbaf-9811-4322-837e-839660a38be0 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.539756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137dbaf-9811-4322-837e-839660a38be0 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.541650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 102/208] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:17.547744 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac97284-8bf4-46d7-ac2e-ccc958a1e621 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.548166 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac97284-8bf4-46d7-ac2e-ccc958a1e621 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.548481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac97284-8bf4-46d7-ac2e-ccc958a1e621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.567009 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-6ac97284-8bf4-46d7-ac2e-ccc958a1e621 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:17.568358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6ac97284-8bf4-46d7-ac2e-ccc958a1e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:17.576251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 107/209] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:17.599669 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137dbaf-9811-4322-837e-839660a38be0 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:17.612391 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137dbaf-9811-4322-837e-839660a38be0 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:17.617114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c13fff-d7c9-4cef-a779-4300baa93053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:17.618016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c13fff-d7c9-4cef-a779-4300baa93053 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.618421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c13fff-d7c9-4cef-a779-4300baa93053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.618804 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c13fff-d7c9-4cef-a779-4300baa93053 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.630830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c13fff-d7c9-4cef-a779-4300baa93053 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:17.639163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-b0c13fff-d7c9-4cef-a779-4300baa93053 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:56:17.640744 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 103/210] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:56:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:17.646943 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac97284-8bf4-46d7-ac2e-ccc958a1e621 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:17.656566 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac97284-8bf4-46d7-ac2e-ccc958a1e621 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:17.661724 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e1d19-845b-401d-b30a-aa9df0427add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:17.662527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e1d19-845b-401d-b30a-aa9df0427add admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.662912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e1d19-845b-401d-b30a-aa9df0427add admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.663291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e1d19-845b-401d-b30a-aa9df0427add admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.664156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e1d19-845b-401d-b30a-aa9df0427add admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:17.664566 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e1d19-845b-401d-b30a-aa9df0427add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:17.666272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e1d19-845b-401d-b30a-aa9df0427add admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:17.675541 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 108/211] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:17.681817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c13fff-d7c9-4cef-a779-4300baa93053 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:17.694243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c13fff-d7c9-4cef-a779-4300baa93053 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:17.698911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355ccaa-9c9a-4267-907c-87cc46287127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:17.699871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355ccaa-9c9a-4267-907c-87cc46287127 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.700257 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355ccaa-9c9a-4267-907c-87cc46287127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.700633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355ccaa-9c9a-4267-907c-87cc46287127 admin admin] PATH_INFO: `/v3/users/15a13f27549f41b3be9714baa3808f8a` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.701939 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355ccaa-9c9a-4267-907c-87cc46287127 admin admin] RBAC: Authorizing `identity:get_user(user_id=15a13f27549f41b3be9714baa3808f8a)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:17.704204 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355ccaa-9c9a-4267-907c-87cc46287127 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:17.706155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 104/212] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:17 2021] GET /identity/v3/users/15a13f27549f41b3be9714baa3808f8a => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:17.712242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e1d19-845b-401d-b30a-aa9df0427add admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:17.723063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e1d19-845b-401d-b30a-aa9df0427add admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:17.727739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f29cd-7598-4067-8f72-499e5a301d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:17.728086 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff0c85-586c-4137-a060-e181f04bdf65 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.728513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff0c85-586c-4137-a060-e181f04bdf65 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.728883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f29cd-7598-4067-8f72-499e5a301d42 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.729095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff0c85-586c-4137-a060-e181f04bdf65 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.729368 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f29cd-7598-4067-8f72-499e5a301d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.729738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f29cd-7598-4067-8f72-499e5a301d42 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.731072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f29cd-7598-4067-8f72-499e5a301d42 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:17.731730 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 105/213] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:17.736087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f29cd-7598-4067-8f72-499e5a301d42 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:17.736087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 109/214] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:17 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:17.737832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb31db-484f-40d3-b96d-1697df73ff1e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.738243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb31db-484f-40d3-b96d-1697df73ff1e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.738663 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb31db-484f-40d3-b96d-1697df73ff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.741889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f29cd-7598-4067-8f72-499e5a301d42 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:17.753989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f29cd-7598-4067-8f72-499e5a301d42 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:17.759043 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b62eb-d9fa-4132-941e-31fa236a42c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:17.759939 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-9deb31db-484f-40d3-b96d-1697df73ff1e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:17.760090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b62eb-d9fa-4132-941e-31fa236a42c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.760476 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b62eb-d9fa-4132-941e-31fa236a42c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.760853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b62eb-d9fa-4132-941e-31fa236a42c1 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff/users/15a13f27549f41b3be9714baa3808f8a/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.762533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9deb31db-484f-40d3-b96d-1697df73ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:17.763098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b62eb-d9fa-4132-941e-31fa236a42c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97292c93fce46b1bf851f877c9530ff, user_id=15a13f27549f41b3be9714baa3808f8a, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:17.766483 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b62eb-d9fa-4132-941e-31fa236a42c1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:17.771136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 106/215] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:17.772718 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc289d-6df7-4bc4-8dcb-ce029124b59d None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.773139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc289d-6df7-4bc4-8dcb-ce029124b59d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.773599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc289d-6df7-4bc4-8dcb-ce029124b59d None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.775581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 107/216] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:17.786210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 110/217] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:17 2021] PUT /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff/users/15a13f27549f41b3be9714baa3808f8a/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 00:56:17.787436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d87f5f-63cb-48a9-8573-4af2c8566db6 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.787792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d87f5f-63cb-48a9-8573-4af2c8566db6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.787941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad7d8f-cec1-465b-9ec9-c615a9ad401b None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.788177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad7d8f-cec1-465b-9ec9-c615a9ad401b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.788279 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d87f5f-63cb-48a9-8573-4af2c8566db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.788448 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad7d8f-cec1-465b-9ec9-c615a9ad401b None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.790462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 111/218] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:17.800248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8e926-3b39-47df-b0de-97b66b17b3f3 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.800858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8e926-3b39-47df-b0de-97b66b17b3f3 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.801356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8e926-3b39-47df-b0de-97b66b17b3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.808679 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-48d87f5f-63cb-48a9-8573-4af2c8566db6 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:17.809968 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-48d87f5f-63cb-48a9-8573-4af2c8566db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:17.821439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-31e8e926-3b39-47df-b0de-97b66b17b3f3 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:17.822799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-31e8e926-3b39-47df-b0de-97b66b17b3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:17.885658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 108/219] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:17.885658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d87f5f-63cb-48a9-8573-4af2c8566db6 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:17.890677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d87f5f-63cb-48a9-8573-4af2c8566db6 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:17.892723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 112/220] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:17.897463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2aadd3-a98c-4ae9-ad45-f0f7c4d99b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:17.898334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aadd3-a98c-4ae9-ad45-f0f7c4d99b24 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.898644 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aadd3-a98c-4ae9-ad45-f0f7c4d99b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.898918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aadd3-a98c-4ae9-ad45-f0f7c4d99b24 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.905862 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8e926-3b39-47df-b0de-97b66b17b3f3 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:17.916287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2aadd3-a98c-4ae9-ad45-f0f7c4d99b24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:17.916609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8e926-3b39-47df-b0de-97b66b17b3f3 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:17.921216 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab925a-900c-4a5c-995c-cf1ce055902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:17.922044 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab925a-900c-4a5c-995c-cf1ce055902b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.922326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab925a-900c-4a5c-995c-cf1ce055902b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.922634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab925a-900c-4a5c-995c-cf1ce055902b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.925838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-4f2aadd3-a98c-4ae9-ad45-f0f7c4d99b24 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:17.927354 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 109/221] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:17.928382 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2aadd3-a98c-4ae9-ad45-f0f7c4d99b24 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:17.938541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2aadd3-a98c-4ae9-ad45-f0f7c4d99b24 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:17.939180 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab925a-900c-4a5c-995c-cf1ce055902b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:17.943702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519c4e2-7700-4519-8655-94d053682763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:17.944778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519c4e2-7700-4519-8655-94d053682763 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.945237 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519c4e2-7700-4519-8655-94d053682763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.945698 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519c4e2-7700-4519-8655-94d053682763 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.946984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-2fab925a-900c-4a5c-995c-cf1ce055902b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:17.947372 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519c4e2-7700-4519-8655-94d053682763 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:17.948255 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 113/222] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:17.948255 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab925a-900c-4a5c-995c-cf1ce055902b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:17.953881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519c4e2-7700-4519-8655-94d053682763 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:17.953881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 110/223] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:17.959790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519c4e2-7700-4519-8655-94d053682763 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:17.963756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab925a-900c-4a5c-995c-cf1ce055902b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:17.968198 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160c7df-91da-42fa-b96a-ce72964e2575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:17.968872 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160c7df-91da-42fa-b96a-ce72964e2575 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.969152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160c7df-91da-42fa-b96a-ce72964e2575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.969430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160c7df-91da-42fa-b96a-ce72964e2575 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.970193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160c7df-91da-42fa-b96a-ce72964e2575 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:17.970531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160c7df-91da-42fa-b96a-ce72964e2575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:17.970772 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519c4e2-7700-4519-8655-94d053682763 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:17.972373 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160c7df-91da-42fa-b96a-ce72964e2575 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:17.976028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a559586-23f1-4ec0-9662-66ded37d46bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:17.976707 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559586-23f1-4ec0-9662-66ded37d46bd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:17.976990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559586-23f1-4ec0-9662-66ded37d46bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:17.977312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559586-23f1-4ec0-9662-66ded37d46bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:17.978139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a559586-23f1-4ec0-9662-66ded37d46bd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:17.978807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a559586-23f1-4ec0-9662-66ded37d46bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:17.980414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a559586-23f1-4ec0-9662-66ded37d46bd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:17.981866 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 114/224] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:17.988592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160c7df-91da-42fa-b96a-ce72964e2575 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:17.999770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 111/225] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:17 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:17.999770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a559586-23f1-4ec0-9662-66ded37d46bd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:18.006784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a559586-23f1-4ec0-9662-66ded37d46bd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:18.006942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160c7df-91da-42fa-b96a-ce72964e2575 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:18.012655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293284e7-f1cb-4e1c-b56c-5dd85a350eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:18.012815 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31906f4b-8587-4f7f-93d0-4c43c29cb93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:18.013410 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906f4b-8587-4f7f-93d0-4c43c29cb93b admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:18.013509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293284e7-f1cb-4e1c-b56c-5dd85a350eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:18.013689 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906f4b-8587-4f7f-93d0-4c43c29cb93b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:18.013790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293284e7-f1cb-4e1c-b56c-5dd85a350eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:18.013961 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906f4b-8587-4f7f-93d0-4c43c29cb93b admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:18.014052 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293284e7-f1cb-4e1c-b56c-5dd85a350eb1 admin admin] PATH_INFO: `/v3/users/55edf09d56824062b9303cf13fc45fed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:18.015688 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31906f4b-8587-4f7f-93d0-4c43c29cb93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:18.018531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31906f4b-8587-4f7f-93d0-4c43c29cb93b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:18.030563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293284e7-f1cb-4e1c-b56c-5dd85a350eb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=55edf09d56824062b9303cf13fc45fed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:18.032801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293284e7-f1cb-4e1c-b56c-5dd85a350eb1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:18.034878 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 112/226] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:17 2021] GET /identity/v3/users/55edf09d56824062b9303cf13fc45fed => generated 297 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:18.035479 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293284e7-f1cb-4e1c-b56c-5dd85a350eb1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:18.040011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 115/227] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:56:17 2021] POST /identity/v3/users => generated 297 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:56:18.043492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31906f4b-8587-4f7f-93d0-4c43c29cb93b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:18.053902 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293284e7-f1cb-4e1c-b56c-5dd85a350eb1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:18.054215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31906f4b-8587-4f7f-93d0-4c43c29cb93b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:18.059252 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80814147-86d3-4473-a514-d4e10b087ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:18.059933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80814147-86d3-4473-a514-d4e10b087ddd admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:18.060215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80814147-86d3-4473-a514-d4e10b087ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:18.060490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80814147-86d3-4473-a514-d4e10b087ddd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:18.060793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6fe42-e920-41cd-823f-a323bdfde969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:18.062145 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6fe42-e920-41cd-823f-a323bdfde969 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:18.062690 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6fe42-e920-41cd-823f-a323bdfde969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:18.063137 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6fe42-e920-41cd-823f-a323bdfde969 admin admin] PATH_INFO: `/v3/users/15a13f27549f41b3be9714baa3808f8a` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:18.064654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6fe42-e920-41cd-823f-a323bdfde969 admin admin] RBAC: Authorizing `identity:get_user(user_id=15a13f27549f41b3be9714baa3808f8a)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:18.068151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6fe42-e920-41cd-823f-a323bdfde969 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:18.070010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80814147-86d3-4473-a514-d4e10b087ddd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:18.070917 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 113/228] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:18 2021] GET /identity/v3/users/15a13f27549f41b3be9714baa3808f8a => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:18.072291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80814147-86d3-4473-a514-d4e10b087ddd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:18.079470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6fe42-e920-41cd-823f-a323bdfde969 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:18.085545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 116/229] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:18.091545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80814147-86d3-4473-a514-d4e10b087ddd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:18.091982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6fe42-e920-41cd-823f-a323bdfde969 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:18.098736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3dda4-64d2-46e2-88bb-b1b2fcfdead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:18.099722 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3dda4-64d2-46e2-88bb-b1b2fcfdead0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:18.100014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3dda4-64d2-46e2-88bb-b1b2fcfdead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:18.100396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3dda4-64d2-46e2-88bb-b1b2fcfdead0 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:18.102161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3dda4-64d2-46e2-88bb-b1b2fcfdead0 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:18.102684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80814147-86d3-4473-a514-d4e10b087ddd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:18.105339 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3dda4-64d2-46e2-88bb-b1b2fcfdead0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:18.107718 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 114/230] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:18 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:18.108097 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961b3a3-7198-4a72-a856-b28dda3a855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:18.109038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961b3a3-7198-4a72-a856-b28dda3a855f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:18.109319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961b3a3-7198-4a72-a856-b28dda3a855f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:18.109590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961b3a3-7198-4a72-a856-b28dda3a855f admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:18.111357 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961b3a3-7198-4a72-a856-b28dda3a855f admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:18.114823 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961b3a3-7198-4a72-a856-b28dda3a855f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:18.114971 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3dda4-64d2-46e2-88bb-b1b2fcfdead0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:18.116841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 117/231] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:18 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:18.123341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961b3a3-7198-4a72-a856-b28dda3a855f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:18.126134 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3dda4-64d2-46e2-88bb-b1b2fcfdead0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:18.130978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5cd47-25d4-4e11-b730-54bb6c909fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:18.132018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5cd47-25d4-4e11-b730-54bb6c909fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:18.132376 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5cd47-25d4-4e11-b730-54bb6c909fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:18.132725 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5cd47-25d4-4e11-b730-54bb6c909fd9 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff/users/15a13f27549f41b3be9714baa3808f8a/roles/1dbfc98083ce41ea943fbb3de6be133e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:18.135079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961b3a3-7198-4a72-a856-b28dda3a855f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:18.135363 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5cd47-25d4-4e11-b730-54bb6c909fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97292c93fce46b1bf851f877c9530ff, user_id=15a13f27549f41b3be9714baa3808f8a, role_id=1dbfc98083ce41ea943fbb3de6be133e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:18.138192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5cd47-25d4-4e11-b730-54bb6c909fd9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:18.139938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a4f83-0460-4c03-b395-ec5b99ee7062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:18.140708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a4f83-0460-4c03-b395-ec5b99ee7062 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:18.141090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a4f83-0460-4c03-b395-ec5b99ee7062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:18.141259 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a4f83-0460-4c03-b395-ec5b99ee7062 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:18.142340 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a4f83-0460-4c03-b395-ec5b99ee7062 admin admin] RBAC: Adding query filter params (role.id=800b8a36452a418b82e9e25cef933520, scope.project.id=c97292c93fce46b1bf851f877c9530ff, user.id=55edf09d56824062b9303cf13fc45fed) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:18.142635 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a4f83-0460-4c03-b395-ec5b99ee7062 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:18.145337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a4f83-0460-4c03-b395-ec5b99ee7062 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:18.152495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 118/232] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:18 2021] GET /identity/v3/role_assignments?user.id=55edf09d56824062b9303cf13fc45fed&scope.project.id=c97292c93fce46b1bf851f877c9530ff&role.id=800b8a36452a418b82e9e25cef933520 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:18.162323 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 115/233] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:18 2021] PUT /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff/users/15a13f27549f41b3be9714baa3808f8a/roles/1dbfc98083ce41ea943fbb3de6be133e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 00:56:20.749659 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092fdc-5fba-405c-a3bd-f9b7ce16a1e2 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:20.750178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092fdc-5fba-405c-a3bd-f9b7ce16a1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:20.750178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092fdc-5fba-405c-a3bd-f9b7ce16a1e2 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:20.752004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 119/234] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:20.758814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8068e52-ce89-4387-8252-404f72cf8fdb None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:20.759342 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8068e52-ce89-4387-8252-404f72cf8fdb None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:20.759416 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8068e52-ce89-4387-8252-404f72cf8fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:20.783373 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e8068e52-ce89-4387-8252-404f72cf8fdb None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:20.785101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e8068e52-ce89-4387-8252-404f72cf8fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:20.863241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 116/235] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:20.899889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092fdc-5fba-405c-a3bd-f9b7ce16a1e2 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:20.925876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092fdc-5fba-405c-a3bd-f9b7ce16a1e2 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:20.934256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e8294-2d51-45aa-a2c4-abf2c30d5bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:20.935099 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e8294-2d51-45aa-a2c4-abf2c30d5bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:20.935384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e8294-2d51-45aa-a2c4-abf2c30d5bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:20.935656 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e8294-2d51-45aa-a2c4-abf2c30d5bc5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:20.963387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e8294-2d51-45aa-a2c4-abf2c30d5bc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:20.970381 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-935e8294-2d51-45aa-a2c4-abf2c30d5bc5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:56:20.980153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 120/236] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:56:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:20.998423 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8068e52-ce89-4387-8252-404f72cf8fdb None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.012880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcb8ae-02b2-4016-a65b-32f5383b40cf None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.013112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcb8ae-02b2-4016-a65b-32f5383b40cf None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.013370 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcb8ae-02b2-4016-a65b-32f5383b40cf None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.019434 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 121/237] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:21 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:21.026526 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8068e52-ce89-4387-8252-404f72cf8fdb None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.027230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe26c7-fe7c-4558-984a-09ed31234ea7 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.027462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe26c7-fe7c-4558-984a-09ed31234ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.027740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe26c7-fe7c-4558-984a-09ed31234ea7 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.029530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 122/238] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:21.034899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d67b25-d8d6-45f2-ab4f-d55c6c4b6cd5 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.035215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d67b25-d8d6-45f2-ab4f-d55c6c4b6cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.035457 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303fa51-1a58-4621-b1bf-5708c1ba6904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.035588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d67b25-d8d6-45f2-ab4f-d55c6c4b6cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.036464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303fa51-1a58-4621-b1bf-5708c1ba6904 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.036938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303fa51-1a58-4621-b1bf-5708c1ba6904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.037405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303fa51-1a58-4621-b1bf-5708c1ba6904 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.038388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303fa51-1a58-4621-b1bf-5708c1ba6904 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:21.038891 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303fa51-1a58-4621-b1bf-5708c1ba6904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.040692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303fa51-1a58-4621-b1bf-5708c1ba6904 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.061181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-75d67b25-d8d6-45f2-ab4f-d55c6c4b6cd5 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:21.061360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 117/239] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.061436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-75d67b25-d8d6-45f2-ab4f-d55c6c4b6cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:21.061504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fb85a-ba48-4c85-93d6-5c39c35dd593 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.061504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fb85a-ba48-4c85-93d6-5c39c35dd593 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.061504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fb85a-ba48-4c85-93d6-5c39c35dd593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.080018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 123/240] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:21.086420 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d67b25-d8d6-45f2-ab4f-d55c6c4b6cd5 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.095381 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-a70fb85a-ba48-4c85-93d6-5c39c35dd593 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:21.096647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a70fb85a-ba48-4c85-93d6-5c39c35dd593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:21.113764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d67b25-d8d6-45f2-ab4f-d55c6c4b6cd5 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.115742 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 118/241] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:21.116767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fb85a-ba48-4c85-93d6-5c39c35dd593 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.132726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fb85a-ba48-4c85-93d6-5c39c35dd593 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.149486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b0e5f-5290-42cf-98fe-98b5a6858317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.149486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b0e5f-5290-42cf-98fe-98b5a6858317 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.149486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b0e5f-5290-42cf-98fe-98b5a6858317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.149486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b0e5f-5290-42cf-98fe-98b5a6858317 admin admin] PATH_INFO: `/v3/users/15a13f27549f41b3be9714baa3808f8a` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.154406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b0e5f-5290-42cf-98fe-98b5a6858317 admin admin] RBAC: Authorizing `identity:get_user(user_id=15a13f27549f41b3be9714baa3808f8a)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.154406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b0e5f-5290-42cf-98fe-98b5a6858317 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.155364 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 124/242] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/users/15a13f27549f41b3be9714baa3808f8a => generated 283 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.156312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b0e5f-5290-42cf-98fe-98b5a6858317 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.167683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddf6e5-d32e-4d03-a974-ce01131769bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.168521 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddf6e5-d32e-4d03-a974-ce01131769bf admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.168804 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddf6e5-d32e-4d03-a974-ce01131769bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.169085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddf6e5-d32e-4d03-a974-ce01131769bf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.173293 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b0e5f-5290-42cf-98fe-98b5a6858317 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.181905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3d5c4-9e66-4990-91fe-38bbb0e884e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.184149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3d5c4-9e66-4990-91fe-38bbb0e884e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.184149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3d5c4-9e66-4990-91fe-38bbb0e884e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.184149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3d5c4-9e66-4990-91fe-38bbb0e884e7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.188710 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddf6e5-d32e-4d03-a974-ce01131769bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:21.196767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-4dddf6e5-d32e-4d03-a974-ce01131769bf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:21.198126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 119/243] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:21.203584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddf6e5-d32e-4d03-a974-ce01131769bf admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.203698 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3d5c4-9e66-4990-91fe-38bbb0e884e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:21.208575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-71c3d5c4-9e66-4990-91fe-38bbb0e884e7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:21.212452 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 125/244] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:21.213318 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddf6e5-d32e-4d03-a974-ce01131769bf admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.215156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3d5c4-9e66-4990-91fe-38bbb0e884e7 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.223924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e68de9-2d94-4ade-b870-015278a70da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.224579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68de9-2d94-4ade-b870-015278a70da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.224852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68de9-2d94-4ade-b870-015278a70da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.225123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68de9-2d94-4ade-b870-015278a70da0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.236462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3d5c4-9e66-4990-91fe-38bbb0e884e7 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.241573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e68de9-2d94-4ade-b870-015278a70da0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.243376 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e68de9-2d94-4ade-b870-015278a70da0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.250612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6296e-f7ca-4cef-bdd9-0463ffbb46af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.251285 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6296e-f7ca-4cef-bdd9-0463ffbb46af admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.251566 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6296e-f7ca-4cef-bdd9-0463ffbb46af admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.251840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6296e-f7ca-4cef-bdd9-0463ffbb46af admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.253581 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6296e-f7ca-4cef-bdd9-0463ffbb46af admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:21.254580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6296e-f7ca-4cef-bdd9-0463ffbb46af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.256187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6296e-f7ca-4cef-bdd9-0463ffbb46af admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.258649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 120/245] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:21.259337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e68de9-2d94-4ade-b870-015278a70da0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.266741 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 126/246] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.268125 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d601ed-1a89-4bec-bf3f-d0e56221e07e None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.268838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d601ed-1a89-4bec-bf3f-d0e56221e07e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.268838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d601ed-1a89-4bec-bf3f-d0e56221e07e None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.274844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 127/247] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:21.274844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d601ed-1a89-4bec-bf3f-d0e56221e07e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.278565 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e68de9-2d94-4ade-b870-015278a70da0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.288290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53658-00ca-4408-bb65-4da15bbb03af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.289141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53658-00ca-4408-bb65-4da15bbb03af admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.289248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53658-00ca-4408-bb65-4da15bbb03af admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.289506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53658-00ca-4408-bb65-4da15bbb03af admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.290271 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53658-00ca-4408-bb65-4da15bbb03af admin admin] RBAC: Adding query filter params (name=member) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:21.290645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53658-00ca-4408-bb65-4da15bbb03af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.292200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53658-00ca-4408-bb65-4da15bbb03af admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.293549 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d601ed-1a89-4bec-bf3f-d0e56221e07e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.297825 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2668e68-62ce-4fe9-a8e2-9616cc178164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.298780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2668e68-62ce-4fe9-a8e2-9616cc178164 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.299270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2668e68-62ce-4fe9-a8e2-9616cc178164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.300201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2668e68-62ce-4fe9-a8e2-9616cc178164 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.301431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 121/248] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.301527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2668e68-62ce-4fe9-a8e2-9616cc178164 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.302221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53658-00ca-4408-bb65-4da15bbb03af admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.303683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2668e68-62ce-4fe9-a8e2-9616cc178164 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.310525 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 128/249] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.310525 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e85b2-1eaf-4f88-b8bc-e21d9855c80a None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.310525 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e85b2-1eaf-4f88-b8bc-e21d9855c80a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.310525 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e85b2-1eaf-4f88-b8bc-e21d9855c80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.324951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53658-00ca-4408-bb65-4da15bbb03af admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.326597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-fc2e85b2-1eaf-4f88-b8bc-e21d9855c80a None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:21.327782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fc2e85b2-1eaf-4f88-b8bc-e21d9855c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:21.330127 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283fcdd-fe51-4a2c-ab99-a405a1d4d6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.331808 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283fcdd-fe51-4a2c-ab99-a405a1d4d6ef admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.332275 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283fcdd-fe51-4a2c-ab99-a405a1d4d6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.332740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283fcdd-fe51-4a2c-ab99-a405a1d4d6ef admin admin] PATH_INFO: `/v3/users/15a13f27549f41b3be9714baa3808f8a` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.334041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283fcdd-fe51-4a2c-ab99-a405a1d4d6ef admin admin] RBAC: Authorizing `identity:get_user(user_id=15a13f27549f41b3be9714baa3808f8a)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.336282 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283fcdd-fe51-4a2c-ab99-a405a1d4d6ef admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.337097 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 129/250] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:21.342459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 122/251] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/users/15a13f27549f41b3be9714baa3808f8a => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.342459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283fcdd-fe51-4a2c-ab99-a405a1d4d6ef admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.343771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e85b2-1eaf-4f88-b8bc-e21d9855c80a None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.354394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283fcdd-fe51-4a2c-ab99-a405a1d4d6ef admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.354394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a4a0e-1299-430d-8f40-82302d222962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.354725 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a4a0e-1299-430d-8f40-82302d222962 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.355130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a4a0e-1299-430d-8f40-82302d222962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.355523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a4a0e-1299-430d-8f40-82302d222962 admin admin] PATH_INFO: `/v3/users/55edf09d56824062b9303cf13fc45fed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.356826 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a4a0e-1299-430d-8f40-82302d222962 admin admin] RBAC: Authorizing `identity:get_user(user_id=55edf09d56824062b9303cf13fc45fed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.359295 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a4a0e-1299-430d-8f40-82302d222962 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.366410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 123/252] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/users/55edf09d56824062b9303cf13fc45fed => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.366410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a4a0e-1299-430d-8f40-82302d222962 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.370711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e85b2-1eaf-4f88-b8bc-e21d9855c80a None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.375998 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc503f-9d16-4c51-ac5d-06053c7e1f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.376649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc503f-9d16-4c51-ac5d-06053c7e1f3a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.376933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc503f-9d16-4c51-ac5d-06053c7e1f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.378021 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc503f-9d16-4c51-ac5d-06053c7e1f3a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.378750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a4a0e-1299-430d-8f40-82302d222962 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.379040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc503f-9d16-4c51-ac5d-06053c7e1f3a admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=c97292c93fce46b1bf851f877c9530ff, user.id=15a13f27549f41b3be9714baa3808f8a) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:21.379365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc503f-9d16-4c51-ac5d-06053c7e1f3a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.381563 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc503f-9d16-4c51-ac5d-06053c7e1f3a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.382937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358f940-22d1-49f3-b093-888793e10f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.383764 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358f940-22d1-49f3-b093-888793e10f6e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.384056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358f940-22d1-49f3-b093-888793e10f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.384338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358f940-22d1-49f3-b093-888793e10f6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.388018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 130/253] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/role_assignments?user.id=15a13f27549f41b3be9714baa3808f8a&scope.project.id=c97292c93fce46b1bf851f877c9530ff&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.388657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc503f-9d16-4c51-ac5d-06053c7e1f3a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.400515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc503f-9d16-4c51-ac5d-06053c7e1f3a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.405199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ee472-671d-44bb-9fee-5f6b44b464af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.406082 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee472-671d-44bb-9fee-5f6b44b464af admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.406378 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee472-671d-44bb-9fee-5f6b44b464af admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.406657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee472-671d-44bb-9fee-5f6b44b464af admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.407945 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ee472-671d-44bb-9fee-5f6b44b464af admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.410699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ee472-671d-44bb-9fee-5f6b44b464af admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.411476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358f940-22d1-49f3-b093-888793e10f6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.412650 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 131/254] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.413251 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358f940-22d1-49f3-b093-888793e10f6e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.419767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e202b-97d6-40e9-9dee-85c4a0b82334 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.420074 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e202b-97d6-40e9-9dee-85c4a0b82334 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.420311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e202b-97d6-40e9-9dee-85c4a0b82334 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.426521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 132/255] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:21 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:21.426521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e202b-97d6-40e9-9dee-85c4a0b82334 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.430911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 124/256] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:21.431841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358f940-22d1-49f3-b093-888793e10f6e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.444935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e202b-97d6-40e9-9dee-85c4a0b82334 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.450119 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94ba4a-efd1-4e65-9d40-02c0a60365a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.450838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358f940-22d1-49f3-b093-888793e10f6e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.451707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94ba4a-efd1-4e65-9d40-02c0a60365a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.452162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94ba4a-efd1-4e65-9d40-02c0a60365a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.452605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94ba4a-efd1-4e65-9d40-02c0a60365a7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.454096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94ba4a-efd1-4e65-9d40-02c0a60365a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.456433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94ba4a-efd1-4e65-9d40-02c0a60365a7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.456575 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065114f-6182-4b75-adeb-aec4ac2a0bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.457616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065114f-6182-4b75-adeb-aec4ac2a0bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.458001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065114f-6182-4b75-adeb-aec4ac2a0bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.458411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065114f-6182-4b75-adeb-aec4ac2a0bcd admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff/users/55edf09d56824062b9303cf13fc45fed/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.459896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 133/257] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.460988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065114f-6182-4b75-adeb-aec4ac2a0bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97292c93fce46b1bf851f877c9530ff, user_id=55edf09d56824062b9303cf13fc45fed, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.461776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fd98c-32e7-48f8-a240-aba41fa4cb37 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.462251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fd98c-32e7-48f8-a240-aba41fa4cb37 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.462750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fd98c-32e7-48f8-a240-aba41fa4cb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.463874 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065114f-6182-4b75-adeb-aec4ac2a0bcd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.486404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-613fd98c-32e7-48f8-a240-aba41fa4cb37 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:21.488683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-613fd98c-32e7-48f8-a240-aba41fa4cb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:21.498747 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 125/258] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:21 2021] PUT /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff/users/55edf09d56824062b9303cf13fc45fed/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:21.498747 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065114f-6182-4b75-adeb-aec4ac2a0bcd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.570549 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 134/259] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:21.571484 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fd98c-32e7-48f8-a240-aba41fa4cb37 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.587625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fd98c-32e7-48f8-a240-aba41fa4cb37 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.598776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069726f-3f0e-4604-a2d6-802ae7613a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.599485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069726f-3f0e-4604-a2d6-802ae7613a84 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.599824 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069726f-3f0e-4604-a2d6-802ae7613a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.600096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069726f-3f0e-4604-a2d6-802ae7613a84 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.600877 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069726f-3f0e-4604-a2d6-802ae7613a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.602913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065114f-6182-4b75-adeb-aec4ac2a0bcd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.603053 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069726f-3f0e-4604-a2d6-802ae7613a84 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.608312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612750c7-7b71-4a77-8f69-ccf929ee1ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.609637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612750c7-7b71-4a77-8f69-ccf929ee1ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.610500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612750c7-7b71-4a77-8f69-ccf929ee1ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.610984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612750c7-7b71-4a77-8f69-ccf929ee1ea4 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.614216 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612750c7-7b71-4a77-8f69-ccf929ee1ea4 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.617210 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612750c7-7b71-4a77-8f69-ccf929ee1ea4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.619406 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 126/260] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.622425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612750c7-7b71-4a77-8f69-ccf929ee1ea4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.630948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612750c7-7b71-4a77-8f69-ccf929ee1ea4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.635780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a043f8-9ecf-4b5d-8b85-d6c09ff69b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.636600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a043f8-9ecf-4b5d-8b85-d6c09ff69b64 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.636928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a043f8-9ecf-4b5d-8b85-d6c09ff69b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.637209 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a043f8-9ecf-4b5d-8b85-d6c09ff69b64 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.638442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 135/261] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:56:21 2021] POST /identity/v3/users => generated 293 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:56:21.639829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069726f-3f0e-4604-a2d6-802ae7613a84 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.650760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a043f8-9ecf-4b5d-8b85-d6c09ff69b64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:21.654310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069726f-3f0e-4604-a2d6-802ae7613a84 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.658130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-77a043f8-9ecf-4b5d-8b85-d6c09ff69b64 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 09 00:56:21.660495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 127/262] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:21.662018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5429a5-7445-420c-9d4d-083108456307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.663095 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5429a5-7445-420c-9d4d-083108456307 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.663884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5429a5-7445-420c-9d4d-083108456307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.664497 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5429a5-7445-420c-9d4d-083108456307 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.665812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5429a5-7445-420c-9d4d-083108456307 admin admin] RBAC: Adding query filter params (role.id=1dbfc98083ce41ea943fbb3de6be133e, scope.project.id=c97292c93fce46b1bf851f877c9530ff, user.id=15a13f27549f41b3be9714baa3808f8a) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:21.666464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5429a5-7445-420c-9d4d-083108456307 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.669645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a043f8-9ecf-4b5d-8b85-d6c09ff69b64 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.670039 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5429a5-7445-420c-9d4d-083108456307 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.678688 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 136/263] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/role_assignments?user.id=15a13f27549f41b3be9714baa3808f8a&scope.project.id=c97292c93fce46b1bf851f877c9530ff&role.id=1dbfc98083ce41ea943fbb3de6be133e => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.682858 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a043f8-9ecf-4b5d-8b85-d6c09ff69b64 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.688556 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122725e-51c7-4fb2-a1f7-7773692a67b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.689255 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122725e-51c7-4fb2-a1f7-7773692a67b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.689538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122725e-51c7-4fb2-a1f7-7773692a67b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.689935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122725e-51c7-4fb2-a1f7-7773692a67b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.690961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122725e-51c7-4fb2-a1f7-7773692a67b6 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:21.691278 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122725e-51c7-4fb2-a1f7-7773692a67b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.692930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122725e-51c7-4fb2-a1f7-7773692a67b6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.704114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 128/264] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:21.711552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5429a5-7445-420c-9d4d-083108456307 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.728173 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5429a5-7445-420c-9d4d-083108456307 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.736371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe67be7-7cc5-4bc4-a502-594a27f9d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.738214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe67be7-7cc5-4bc4-a502-594a27f9d1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.738809 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe67be7-7cc5-4bc4-a502-594a27f9d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.739324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe67be7-7cc5-4bc4-a502-594a27f9d1c1 admin admin] PATH_INFO: `/v3/users/01239f23d2054667b379358167a4fa8e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.756978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe67be7-7cc5-4bc4-a502-594a27f9d1c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=01239f23d2054667b379358167a4fa8e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.760155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe67be7-7cc5-4bc4-a502-594a27f9d1c1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.762244 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 137/265] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/users/01239f23d2054667b379358167a4fa8e => generated 297 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.769191 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122725e-51c7-4fb2-a1f7-7773692a67b6 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.785856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122725e-51c7-4fb2-a1f7-7773692a67b6 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.792647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79d47b-b58e-4da8-bbcd-9245184e7cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.793334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79d47b-b58e-4da8-bbcd-9245184e7cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.793628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79d47b-b58e-4da8-bbcd-9245184e7cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.793902 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79d47b-b58e-4da8-bbcd-9245184e7cb1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.805061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79d47b-b58e-4da8-bbcd-9245184e7cb1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.806930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79d47b-b58e-4da8-bbcd-9245184e7cb1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.819124 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 129/266] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:21.825421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe67be7-7cc5-4bc4-a502-594a27f9d1c1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.839776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe67be7-7cc5-4bc4-a502-594a27f9d1c1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.855810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d581a8-efe8-42e8-b948-ca6792376c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.856705 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d581a8-efe8-42e8-b948-ca6792376c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.856986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d581a8-efe8-42e8-b948-ca6792376c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.857302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d581a8-efe8-42e8-b948-ca6792376c66 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.858638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d581a8-efe8-42e8-b948-ca6792376c66 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.860801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d581a8-efe8-42e8-b948-ca6792376c66 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.863385 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 138/267] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:21.870110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79d47b-b58e-4da8-bbcd-9245184e7cb1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:21.883554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79d47b-b58e-4da8-bbcd-9245184e7cb1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:21.889904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8ec89-1f68-43ab-b346-d2989458ebbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:21.890609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8ec89-1f68-43ab-b346-d2989458ebbd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:21.890891 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8ec89-1f68-43ab-b346-d2989458ebbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:21.891195 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8ec89-1f68-43ab-b346-d2989458ebbd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:21.892092 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8ec89-1f68-43ab-b346-d2989458ebbd admin admin] RBAC: Adding query filter params (role.id=ac14076037e141cc9378a1773da23f3e, scope.project.id=c97292c93fce46b1bf851f877c9530ff, user.id=01239f23d2054667b379358167a4fa8e) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:21.892408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8ec89-1f68-43ab-b346-d2989458ebbd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:21.895027 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8ec89-1f68-43ab-b346-d2989458ebbd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:21.901993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 130/268] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:21 2021] GET /identity/v3/role_assignments?user.id=01239f23d2054667b379358167a4fa8e&scope.project.id=c97292c93fce46b1bf851f877c9530ff&role.id=ac14076037e141cc9378a1773da23f3e => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:24.000542 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9cea-9fe1-42ad-8cdf-3356bf0b7e17 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.001050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9cea-9fe1-42ad-8cdf-3356bf0b7e17 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.001199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9cea-9fe1-42ad-8cdf-3356bf0b7e17 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.003294 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 139/269] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:24.009120 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540dab-7f2c-4136-ba12-8484debb37e9 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.009543 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540dab-7f2c-4136-ba12-8484debb37e9 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.009715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540dab-7f2c-4136-ba12-8484debb37e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.028797 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-10540dab-7f2c-4136-ba12-8484debb37e9 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:24.029983 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-10540dab-7f2c-4136-ba12-8484debb37e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:24.038167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 131/270] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:24.062089 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9cea-9fe1-42ad-8cdf-3356bf0b7e17 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.075761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9cea-9fe1-42ad-8cdf-3356bf0b7e17 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.080075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445f8c1-c08a-44fb-a34f-2256a7358956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.081424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445f8c1-c08a-44fb-a34f-2256a7358956 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.081700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445f8c1-c08a-44fb-a34f-2256a7358956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.081970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445f8c1-c08a-44fb-a34f-2256a7358956 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.092457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445f8c1-c08a-44fb-a34f-2256a7358956 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:24.099528 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-e445f8c1-c08a-44fb-a34f-2256a7358956 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:24.101007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 140/271] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:24.107179 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10540dab-7f2c-4136-ba12-8484debb37e9 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.117503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10540dab-7f2c-4136-ba12-8484debb37e9 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.121991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6c42-2ebd-4490-a33b-ea1acf1108f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.122690 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6c42-2ebd-4490-a33b-ea1acf1108f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.122970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6c42-2ebd-4490-a33b-ea1acf1108f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.123247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6c42-2ebd-4490-a33b-ea1acf1108f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.124005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f6c42-2ebd-4490-a33b-ea1acf1108f6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:24.124308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f6c42-2ebd-4490-a33b-ea1acf1108f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.125909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f6c42-2ebd-4490-a33b-ea1acf1108f6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.134789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 132/272] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:24.140725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445f8c1-c08a-44fb-a34f-2256a7358956 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.151196 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445f8c1-c08a-44fb-a34f-2256a7358956 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.155632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c392a22-a51c-4573-adf4-36fb7db92933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.156491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c392a22-a51c-4573-adf4-36fb7db92933 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.156771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c392a22-a51c-4573-adf4-36fb7db92933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.157046 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c392a22-a51c-4573-adf4-36fb7db92933 admin admin] PATH_INFO: `/v3/users/55edf09d56824062b9303cf13fc45fed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.158259 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c392a22-a51c-4573-adf4-36fb7db92933 admin admin] RBAC: Authorizing `identity:get_user(user_id=55edf09d56824062b9303cf13fc45fed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.160532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c392a22-a51c-4573-adf4-36fb7db92933 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.162439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 141/273] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/users/55edf09d56824062b9303cf13fc45fed => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:24.171452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6c42-2ebd-4490-a33b-ea1acf1108f6 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.181611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6c42-2ebd-4490-a33b-ea1acf1108f6 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.186079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6c301-e020-4e2a-aa15-f205c79ef309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.186743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c301-e020-4e2a-aa15-f205c79ef309 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.187020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c301-e020-4e2a-aa15-f205c79ef309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.187294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c301-e020-4e2a-aa15-f205c79ef309 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.196285 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6c301-e020-4e2a-aa15-f205c79ef309 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.198027 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6c301-e020-4e2a-aa15-f205c79ef309 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.207340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 133/274] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 09 00:56:24.213443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c392a22-a51c-4573-adf4-36fb7db92933 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.224676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c392a22-a51c-4573-adf4-36fb7db92933 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.229148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913816a-c91f-43b6-b11f-a46f3f433814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.229987 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913816a-c91f-43b6-b11f-a46f3f433814 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.230269 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913816a-c91f-43b6-b11f-a46f3f433814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.230576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913816a-c91f-43b6-b11f-a46f3f433814 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.231781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913816a-c91f-43b6-b11f-a46f3f433814 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.233820 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913816a-c91f-43b6-b11f-a46f3f433814 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.235847 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 142/275] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:24.242449 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6c301-e020-4e2a-aa15-f205c79ef309 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.250633 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac65129-4913-4226-8675-a67cccda0e6c None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.250916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac65129-4913-4226-8675-a67cccda0e6c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.251193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac65129-4913-4226-8675-a67cccda0e6c None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.251652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6c301-e020-4e2a-aa15-f205c79ef309 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.253580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 143/276] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:24.257308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe5e3b-36fd-4f0d-b27b-1516fda70dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.258195 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe5e3b-36fd-4f0d-b27b-1516fda70dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.258654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe5e3b-36fd-4f0d-b27b-1516fda70dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.259073 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe5e3b-36fd-4f0d-b27b-1516fda70dbe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.259204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18635575-6cda-4628-abda-ea3dc0af445d None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.259461 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18635575-6cda-4628-abda-ea3dc0af445d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.259739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18635575-6cda-4628-abda-ea3dc0af445d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.260458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe5e3b-36fd-4f0d-b27b-1516fda70dbe admin admin] RBAC: Adding query filter params (role.id=800b8a36452a418b82e9e25cef933520, scope.project.id=c97292c93fce46b1bf851f877c9530ff, user.id=55edf09d56824062b9303cf13fc45fed) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:24.260912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe5e3b-36fd-4f0d-b27b-1516fda70dbe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.263017 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe5e3b-36fd-4f0d-b27b-1516fda70dbe admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.269947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 134/277] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/role_assignments?user.id=55edf09d56824062b9303cf13fc45fed&scope.project.id=c97292c93fce46b1bf851f877c9530ff&role.id=800b8a36452a418b82e9e25cef933520 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:24.278147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-18635575-6cda-4628-abda-ea3dc0af445d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:24.279508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-18635575-6cda-4628-abda-ea3dc0af445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:24.294483 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 144/278] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:24.310248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffba5c-c7b8-4f9e-b528-f6b173e9fb40 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.310687 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffba5c-c7b8-4f9e-b528-f6b173e9fb40 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.310974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffba5c-c7b8-4f9e-b528-f6b173e9fb40 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.313117 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 135/279] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:24.315531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18635575-6cda-4628-abda-ea3dc0af445d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.319741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5666c9a-33f1-4e5b-8804-79c71eadbd99 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.320029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5666c9a-33f1-4e5b-8804-79c71eadbd99 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.320308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5666c9a-33f1-4e5b-8804-79c71eadbd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.325556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18635575-6cda-4628-abda-ea3dc0af445d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.330135 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0016145-1627-42da-a2aa-e99323e41697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.331163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0016145-1627-42da-a2aa-e99323e41697 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.331436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0016145-1627-42da-a2aa-e99323e41697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.331704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0016145-1627-42da-a2aa-e99323e41697 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.338649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b5666c9a-33f1-4e5b-8804-79c71eadbd99 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:24.339881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b5666c9a-33f1-4e5b-8804-79c71eadbd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:24.344012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0016145-1627-42da-a2aa-e99323e41697 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:24.349304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 136/280] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:24.352380 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-c0016145-1627-42da-a2aa-e99323e41697 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:24.353764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 145/281] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:24.358755 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981e212-cca4-412e-9d3d-16e1e32910e6 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.359047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981e212-cca4-412e-9d3d-16e1e32910e6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.359334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981e212-cca4-412e-9d3d-16e1e32910e6 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.359912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0016145-1627-42da-a2aa-e99323e41697 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.361500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 137/282] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:24.370135 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006834d-4b22-49b6-88a9-2e1e177a4b16 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.370476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006834d-4b22-49b6-88a9-2e1e177a4b16 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.370698 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0016145-1627-42da-a2aa-e99323e41697 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.370859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006834d-4b22-49b6-88a9-2e1e177a4b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.375209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1848a-e958-4cf8-94ca-ef77e33b3794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.375878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1848a-e958-4cf8-94ca-ef77e33b3794 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.376157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1848a-e958-4cf8-94ca-ef77e33b3794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.376434 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1848a-e958-4cf8-94ca-ef77e33b3794 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.377983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1848a-e958-4cf8-94ca-ef77e33b3794 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:24.378683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1848a-e958-4cf8-94ca-ef77e33b3794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.380052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1848a-e958-4cf8-94ca-ef77e33b3794 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.389810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 146/283] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:24.390385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-0006834d-4b22-49b6-88a9-2e1e177a4b16 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:24.391383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1848a-e958-4cf8-94ca-ef77e33b3794 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.391631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0006834d-4b22-49b6-88a9-2e1e177a4b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:24.400430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 138/284] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:24.403010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1848a-e958-4cf8-94ca-ef77e33b3794 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.407358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5634e1-56bd-4c93-b7ff-475586750f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.407963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006834d-4b22-49b6-88a9-2e1e177a4b16 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.408163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5634e1-56bd-4c93-b7ff-475586750f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.409065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5634e1-56bd-4c93-b7ff-475586750f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.410057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5634e1-56bd-4c93-b7ff-475586750f38 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.411350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5634e1-56bd-4c93-b7ff-475586750f38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.413076 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5634e1-56bd-4c93-b7ff-475586750f38 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.414819 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 147/285] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:24.420861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006834d-4b22-49b6-88a9-2e1e177a4b16 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.421051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5634e1-56bd-4c93-b7ff-475586750f38 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.426245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8d1b4-9ded-410a-935c-6dfcf16b165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.427332 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8d1b4-9ded-410a-935c-6dfcf16b165b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.427614 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8d1b4-9ded-410a-935c-6dfcf16b165b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.427887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8d1b4-9ded-410a-935c-6dfcf16b165b admin admin] PATH_INFO: `/v3/users/8a4eeafa74e74ecfb1994e14cc219ca8` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.432378 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5634e1-56bd-4c93-b7ff-475586750f38 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.437214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c54f6-79fa-482d-ba67-68f86397dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.437880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c54f6-79fa-482d-ba67-68f86397dc7a admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.438420 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c54f6-79fa-482d-ba67-68f86397dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.438420 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c54f6-79fa-482d-ba67-68f86397dc7a admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.439169 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c54f6-79fa-482d-ba67-68f86397dc7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.442492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c54f6-79fa-482d-ba67-68f86397dc7a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.445247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8d1b4-9ded-410a-935c-6dfcf16b165b admin admin] RBAC: Authorizing `identity:get_user(user_id=8a4eeafa74e74ecfb1994e14cc219ca8)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.447812 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8d1b4-9ded-410a-935c-6dfcf16b165b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.450056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 139/286] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/users/8a4eeafa74e74ecfb1994e14cc219ca8 => generated 293 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:24.455659 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8d1b4-9ded-410a-935c-6dfcf16b165b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.465985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8d1b4-9ded-410a-935c-6dfcf16b165b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.466435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 148/287] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:56:24 2021] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 00:56:24.467481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c54f6-79fa-482d-ba67-68f86397dc7a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.476121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876e6d6-1edf-4c3a-9c54-2de609a78f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.476936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876e6d6-1edf-4c3a-9c54-2de609a78f99 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.477218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876e6d6-1edf-4c3a-9c54-2de609a78f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.477494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876e6d6-1edf-4c3a-9c54-2de609a78f99 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.480464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c54f6-79fa-482d-ba67-68f86397dc7a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.487177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c2958-15cd-46a9-a276-f49c33a29912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.488847 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c2958-15cd-46a9-a276-f49c33a29912 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.489356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c2958-15cd-46a9-a276-f49c33a29912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.489896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c2958-15cd-46a9-a276-f49c33a29912 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.491053 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c2958-15cd-46a9-a276-f49c33a29912 admin admin] RBAC: Adding query filter params (role.id=800b8a36452a418b82e9e25cef933520, user.id=8a4eeafa74e74ecfb1994e14cc219ca8, scope.system=all) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:24.491446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c2958-15cd-46a9-a276-f49c33a29912 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.493579 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c2958-15cd-46a9-a276-f49c33a29912 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.494685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876e6d6-1edf-4c3a-9c54-2de609a78f99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:24.501979 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-8876e6d6-1edf-4c3a-9c54-2de609a78f99 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 09 00:56:24.503742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 149/288] 10.222.0.23 () {56 vars in 1329 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/role_assignments?user.id=8a4eeafa74e74ecfb1994e14cc219ca8&scope.system=all&role.id=800b8a36452a418b82e9e25cef933520 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:24.504835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 140/289] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:24.511844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c2958-15cd-46a9-a276-f49c33a29912 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.523113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c2958-15cd-46a9-a276-f49c33a29912 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.528093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf634b-6b54-41ad-af2d-b1066f0051ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.528807 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf634b-6b54-41ad-af2d-b1066f0051ad admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.529095 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf634b-6b54-41ad-af2d-b1066f0051ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.529377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf634b-6b54-41ad-af2d-b1066f0051ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.530192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf634b-6b54-41ad-af2d-b1066f0051ad admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:24.530547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf634b-6b54-41ad-af2d-b1066f0051ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.532308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf634b-6b54-41ad-af2d-b1066f0051ad admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.544616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 150/290] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:24.552427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876e6d6-1edf-4c3a-9c54-2de609a78f99 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.563948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876e6d6-1edf-4c3a-9c54-2de609a78f99 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.570993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76e52d-eb92-459d-aaaa-4ef1e24dd022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.572077 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76e52d-eb92-459d-aaaa-4ef1e24dd022 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.572466 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76e52d-eb92-459d-aaaa-4ef1e24dd022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.572840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76e52d-eb92-459d-aaaa-4ef1e24dd022 admin admin] PATH_INFO: `/v3/users/01239f23d2054667b379358167a4fa8e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.574442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76e52d-eb92-459d-aaaa-4ef1e24dd022 admin admin] RBAC: Authorizing `identity:get_user(user_id=01239f23d2054667b379358167a4fa8e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.576884 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76e52d-eb92-459d-aaaa-4ef1e24dd022 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.578900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 141/291] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/users/01239f23d2054667b379358167a4fa8e => generated 297 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:24.586418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf634b-6b54-41ad-af2d-b1066f0051ad admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.598476 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf634b-6b54-41ad-af2d-b1066f0051ad admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.603715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3be35a-4ebe-432b-8a3f-c46ab5af07d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.604952 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3be35a-4ebe-432b-8a3f-c46ab5af07d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.605442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3be35a-4ebe-432b-8a3f-c46ab5af07d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.605920 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3be35a-4ebe-432b-8a3f-c46ab5af07d3 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.607372 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3be35a-4ebe-432b-8a3f-c46ab5af07d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.609793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3be35a-4ebe-432b-8a3f-c46ab5af07d3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.611820 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 151/292] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:24 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:24.618666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76e52d-eb92-459d-aaaa-4ef1e24dd022 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:24.632679 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76e52d-eb92-459d-aaaa-4ef1e24dd022 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:24.640764 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f596e18-699b-4c83-8f76-418d878425e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:24.641691 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f596e18-699b-4c83-8f76-418d878425e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:24.641975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f596e18-699b-4c83-8f76-418d878425e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:24.642314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f596e18-699b-4c83-8f76-418d878425e4 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff/users/01239f23d2054667b379358167a4fa8e/roles/ac14076037e141cc9378a1773da23f3e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:24.646310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f596e18-699b-4c83-8f76-418d878425e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97292c93fce46b1bf851f877c9530ff, user_id=01239f23d2054667b379358167a4fa8e, role_id=ac14076037e141cc9378a1773da23f3e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:24.649165 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f596e18-699b-4c83-8f76-418d878425e4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:24.667929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 142/293] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:24 2021] PUT /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff/users/01239f23d2054667b379358167a4fa8e/roles/ac14076037e141cc9378a1773da23f3e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:26.880052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fcc94-28e1-4d10-b80f-0a3b6259d27d None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:26.880551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fcc94-28e1-4d10-b80f-0a3b6259d27d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:26.880625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fcc94-28e1-4d10-b80f-0a3b6259d27d None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:26.882672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 152/294] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:26.888728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc28ed-0959-4913-8992-ea498b07240f None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:26.889147 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc28ed-0959-4913-8992-ea498b07240f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:26.889332 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc28ed-0959-4913-8992-ea498b07240f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:26.908032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-0ccc28ed-0959-4913-8992-ea498b07240f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:26.909277 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0ccc28ed-0959-4913-8992-ea498b07240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:26.966058 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 143/295] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:26.989516 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fcc94-28e1-4d10-b80f-0a3b6259d27d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.001569 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fcc94-28e1-4d10-b80f-0a3b6259d27d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.006130 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6a810-a46a-47d3-bacf-088c1e9ec107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.006937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6a810-a46a-47d3-bacf-088c1e9ec107 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.007215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6a810-a46a-47d3-bacf-088c1e9ec107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.007486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6a810-a46a-47d3-bacf-088c1e9ec107 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.025179 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6a810-a46a-47d3-bacf-088c1e9ec107 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:27.032226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-daf6a810-a46a-47d3-bacf-088c1e9ec107 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:27.033619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 153/296] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:27.040052 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc28ed-0959-4913-8992-ea498b07240f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.045696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b1538-33fc-4ba2-b007-531b48a36fa8 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.046188 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b1538-33fc-4ba2-b007-531b48a36fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.046670 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b1538-33fc-4ba2-b007-531b48a36fa8 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.048616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 154/297] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:27.050602 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc28ed-0959-4913-8992-ea498b07240f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.055396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd576cb9-4c17-4529-b8d7-e6ca3d3d1dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.055885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3687f6-66c2-4a99-9a6e-3ad7d9bf657c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.056048 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd576cb9-4c17-4529-b8d7-e6ca3d3d1dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.056337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd576cb9-4c17-4529-b8d7-e6ca3d3d1dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.056616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd576cb9-4c17-4529-b8d7-e6ca3d3d1dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.056852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3687f6-66c2-4a99-9a6e-3ad7d9bf657c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.057288 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3687f6-66c2-4a99-9a6e-3ad7d9bf657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.057385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd576cb9-4c17-4529-b8d7-e6ca3d3d1dbc admin admin] RBAC: Adding query filter params (name=member) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:27.057677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd576cb9-4c17-4529-b8d7-e6ca3d3d1dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.059303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd576cb9-4c17-4529-b8d7-e6ca3d3d1dbc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.068780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 144/298] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:27.074840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd576cb9-4c17-4529-b8d7-e6ca3d3d1dbc admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.076504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-fa3687f6-66c2-4a99-9a6e-3ad7d9bf657c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:27.077868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fa3687f6-66c2-4a99-9a6e-3ad7d9bf657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:27.085631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd576cb9-4c17-4529-b8d7-e6ca3d3d1dbc admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.086238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 155/299] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:27.087480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05001b2-0833-46e0-8e23-5f89c9b4a355 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.087774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05001b2-0833-46e0-8e23-5f89c9b4a355 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.088056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05001b2-0833-46e0-8e23-5f89c9b4a355 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.089705 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 156/300] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:27.094239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3e8e0-937d-4dbd-8b9d-eb2d9dd155d7 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.094239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3e8e0-937d-4dbd-8b9d-eb2d9dd155d7 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.094239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3e8e0-937d-4dbd-8b9d-eb2d9dd155d7 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.094239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 157/301] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:27.095814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5871e40-94e3-456b-9acc-eca482413bbc None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.096104 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5871e40-94e3-456b-9acc-eca482413bbc None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.096376 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5871e40-94e3-456b-9acc-eca482413bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.097371 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6a0b9-c4fd-4cfb-9fc8-c88da61fe016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.098244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6a0b9-c4fd-4cfb-9fc8-c88da61fe016 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.098578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6a0b9-c4fd-4cfb-9fc8-c88da61fe016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.098911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6a0b9-c4fd-4cfb-9fc8-c88da61fe016 admin admin] PATH_INFO: `/v3/users/8a4eeafa74e74ecfb1994e14cc219ca8` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.100079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6a0b9-c4fd-4cfb-9fc8-c88da61fe016 admin admin] RBAC: Authorizing `identity:get_user(user_id=8a4eeafa74e74ecfb1994e14cc219ca8)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.102202 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6a0b9-c4fd-4cfb-9fc8-c88da61fe016 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.104080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 145/302] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/users/8a4eeafa74e74ecfb1994e14cc219ca8 => generated 293 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:27.104985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563a59-da8f-40cb-a234-6ec57e4f4087 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.105272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563a59-da8f-40cb-a234-6ec57e4f4087 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.105552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563a59-da8f-40cb-a234-6ec57e4f4087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.115128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d5871e40-94e3-456b-9acc-eca482413bbc None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:27.116306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d5871e40-94e3-456b-9acc-eca482413bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:27.123660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 158/303] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:27.124450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5871e40-94e3-456b-9acc-eca482413bbc None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.126569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-63563a59-da8f-40cb-a234-6ec57e4f4087 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:27.128445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-63563a59-da8f-40cb-a234-6ec57e4f4087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:27.134072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5871e40-94e3-456b-9acc-eca482413bbc None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.138312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9102fe-23aa-4000-abe7-d06f5861dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.139157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9102fe-23aa-4000-abe7-d06f5861dd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.139429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9102fe-23aa-4000-abe7-d06f5861dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.139696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9102fe-23aa-4000-abe7-d06f5861dd46 admin admin] PATH_INFO: `/v3/system/users/8a4eeafa74e74ecfb1994e14cc219ca8/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.141153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9102fe-23aa-4000-abe7-d06f5861dd46 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8a4eeafa74e74ecfb1994e14cc219ca8, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.142155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-0b9102fe-23aa-4000-abe7-d06f5861dd46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:27.142155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:56:27.142155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:56:27.143297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9102fe-23aa-4000-abe7-d06f5861dd46 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.144866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 146/304] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:27.145973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63563a59-da8f-40cb-a234-6ec57e4f4087 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.157053 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63563a59-da8f-40cb-a234-6ec57e4f4087 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.157213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 159/305] 10.222.0.23 () {58 vars in 1355 bytes} [Thu Dec 9 00:56:27 2021] PUT /identity/v3/system/users/8a4eeafa74e74ecfb1994e14cc219ca8/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:27.157883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9102fe-23aa-4000-abe7-d06f5861dd46 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.172289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9102fe-23aa-4000-abe7-d06f5861dd46 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.172493 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742c9ac-4f19-4a8c-b072-d8c42bb94389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.173207 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742c9ac-4f19-4a8c-b072-d8c42bb94389 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.173542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742c9ac-4f19-4a8c-b072-d8c42bb94389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.173827 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742c9ac-4f19-4a8c-b072-d8c42bb94389 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.177080 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c79e8-620c-498a-b7f0-67c981a1371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.177890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c79e8-620c-498a-b7f0-67c981a1371b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.178167 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c79e8-620c-498a-b7f0-67c981a1371b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.178481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c79e8-620c-498a-b7f0-67c981a1371b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.179747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c79e8-620c-498a-b7f0-67c981a1371b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.181742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c79e8-620c-498a-b7f0-67c981a1371b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.183623 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 160/306] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:27.184439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c79e8-620c-498a-b7f0-67c981a1371b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.196476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742c9ac-4f19-4a8c-b072-d8c42bb94389 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:27.197946 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c79e8-620c-498a-b7f0-67c981a1371b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.203586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4efc7-e2c5-4360-b761-75ca225dac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.204587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4efc7-e2c5-4360-b761-75ca225dac01 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.204866 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4efc7-e2c5-4360-b761-75ca225dac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.205190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4efc7-e2c5-4360-b761-75ca225dac01 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.208368 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-1742c9ac-4f19-4a8c-b072-d8c42bb94389 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 09 00:56:27.209861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 147/307] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/roles/reader => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:27.210889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742c9ac-4f19-4a8c-b072-d8c42bb94389 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.224354 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742c9ac-4f19-4a8c-b072-d8c42bb94389 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.228915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4efc7-e2c5-4360-b761-75ca225dac01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:27.233935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36220a-4376-4e02-90a6-5da937baca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.234878 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36220a-4376-4e02-90a6-5da937baca3f admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.235377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36220a-4376-4e02-90a6-5da937baca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.235837 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36220a-4376-4e02-90a6-5da937baca3f admin admin] PATH_INFO: `/v3/groups` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.236062 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-61d4efc7-e2c5-4360-b761-75ca225dac01 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 09 00:56:27.236793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36220a-4376-4e02-90a6-5da937baca3f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.237796 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 161/308] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/roles/reader => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:27.242245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-bd36220a-4376-4e02-90a6-5da937baca3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:27.242245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:56:27.242245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:56:27.242557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4efc7-e2c5-4360-b761-75ca225dac01 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.242627 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36220a-4376-4e02-90a6-5da937baca3f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.270404 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 148/309] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Dec 9 00:56:27 2021] POST /identity/v3/groups => generated 229 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:56:27.270635 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4efc7-e2c5-4360-b761-75ca225dac01 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.270752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36220a-4376-4e02-90a6-5da937baca3f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.274179 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b46f7-89e1-4cef-9ec7-3b5445357389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.274996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b46f7-89e1-4cef-9ec7-3b5445357389 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.275377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b46f7-89e1-4cef-9ec7-3b5445357389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.275710 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b46f7-89e1-4cef-9ec7-3b5445357389 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.276579 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b46f7-89e1-4cef-9ec7-3b5445357389 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:27.276969 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b46f7-89e1-4cef-9ec7-3b5445357389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.278755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b46f7-89e1-4cef-9ec7-3b5445357389 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.281767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36220a-4376-4e02-90a6-5da937baca3f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.287436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df3bf-ec47-4bf4-8262-4efda11b99f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.288277 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df3bf-ec47-4bf4-8262-4efda11b99f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.288662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df3bf-ec47-4bf4-8262-4efda11b99f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.288977 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 162/310] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:27.289085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df3bf-ec47-4bf4-8262-4efda11b99f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.289908 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40df3bf-ec47-4bf4-8262-4efda11b99f1 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:27.290289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40df3bf-ec47-4bf4-8262-4efda11b99f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.292056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40df3bf-ec47-4bf4-8262-4efda11b99f1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.295403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b46f7-89e1-4cef-9ec7-3b5445357389 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.307764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b46f7-89e1-4cef-9ec7-3b5445357389 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.308707 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 149/311] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:27.310111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df3bf-ec47-4bf4-8262-4efda11b99f1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.313890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439070cd-cb31-4965-871d-70979dae631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.315838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439070cd-cb31-4965-871d-70979dae631a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.316312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439070cd-cb31-4965-871d-70979dae631a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.317044 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439070cd-cb31-4965-871d-70979dae631a admin admin] PATH_INFO: `/v3/users/9a84bfeab3b44d95aaac49c563c397fe` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.322139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df3bf-ec47-4bf4-8262-4efda11b99f1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.327002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8b346-9963-46ca-bd23-493a8f0e3a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.328041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8b346-9963-46ca-bd23-493a8f0e3a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.328419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8b346-9963-46ca-bd23-493a8f0e3a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.328765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8b346-9963-46ca-bd23-493a8f0e3a58 admin admin] PATH_INFO: `/v3/users/01239f23d2054667b379358167a4fa8e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.331009 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8b346-9963-46ca-bd23-493a8f0e3a58 admin admin] RBAC: Authorizing `identity:get_user(user_id=01239f23d2054667b379358167a4fa8e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.333979 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8b346-9963-46ca-bd23-493a8f0e3a58 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.336214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439070cd-cb31-4965-871d-70979dae631a admin admin] RBAC: Authorizing `identity:get_user(user_id=9a84bfeab3b44d95aaac49c563c397fe)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.339035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439070cd-cb31-4965-871d-70979dae631a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.341580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 150/312] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/users/01239f23d2054667b379358167a4fa8e => generated 297 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:27.341962 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 163/313] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/users/9a84bfeab3b44d95aaac49c563c397fe => generated 293 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:27.348240 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8b346-9963-46ca-bd23-493a8f0e3a58 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.350533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439070cd-cb31-4965-871d-70979dae631a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.354323 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8b346-9963-46ca-bd23-493a8f0e3a58 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.359336 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90265aaf-a63d-479b-968e-12f8d93d2849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.360380 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90265aaf-a63d-479b-968e-12f8d93d2849 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.360865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90265aaf-a63d-479b-968e-12f8d93d2849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.360970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439070cd-cb31-4965-871d-70979dae631a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.361468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90265aaf-a63d-479b-968e-12f8d93d2849 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.366871 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eed1e7-c2e4-44fb-8a75-6258ea15fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.367558 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eed1e7-c2e4-44fb-8a75-6258ea15fc02 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.367954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eed1e7-c2e4-44fb-8a75-6258ea15fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.368120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eed1e7-c2e4-44fb-8a75-6258ea15fc02 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.368972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eed1e7-c2e4-44fb-8a75-6258ea15fc02 admin admin] RBAC: Adding query filter params (role.id=ac14076037e141cc9378a1773da23f3e, user.id=9a84bfeab3b44d95aaac49c563c397fe, scope.system=all) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:27.369286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eed1e7-c2e4-44fb-8a75-6258ea15fc02 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.371330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eed1e7-c2e4-44fb-8a75-6258ea15fc02 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.373088 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90265aaf-a63d-479b-968e-12f8d93d2849 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.375190 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90265aaf-a63d-479b-968e-12f8d93d2849 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.383040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 164/314] 10.222.0.23 () {56 vars in 1329 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/role_assignments?user.id=9a84bfeab3b44d95aaac49c563c397fe&scope.system=all&role.id=ac14076037e141cc9378a1773da23f3e => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:27.391303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 151/315] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:27.398906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eed1e7-c2e4-44fb-8a75-6258ea15fc02 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.414215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eed1e7-c2e4-44fb-8a75-6258ea15fc02 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.422516 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536e134-6579-4bf8-8f6b-3e2b68950a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.423417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536e134-6579-4bf8-8f6b-3e2b68950a57 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.423702 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536e134-6579-4bf8-8f6b-3e2b68950a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.424065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536e134-6579-4bf8-8f6b-3e2b68950a57 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.427109 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536e134-6579-4bf8-8f6b-3e2b68950a57 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.429221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536e134-6579-4bf8-8f6b-3e2b68950a57 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.431105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 165/316] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:27.437859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90265aaf-a63d-479b-968e-12f8d93d2849 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:27.449651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90265aaf-a63d-479b-968e-12f8d93d2849 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:27.454739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94230a5a-d82d-4d40-a3ad-54324180256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:27.455653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230a5a-d82d-4d40-a3ad-54324180256c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:27.456290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230a5a-d82d-4d40-a3ad-54324180256c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:27.456290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230a5a-d82d-4d40-a3ad-54324180256c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:27.457198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94230a5a-d82d-4d40-a3ad-54324180256c admin admin] RBAC: Adding query filter params (role.id=ac14076037e141cc9378a1773da23f3e, scope.project.id=c97292c93fce46b1bf851f877c9530ff, user.id=01239f23d2054667b379358167a4fa8e) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:27.457619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94230a5a-d82d-4d40-a3ad-54324180256c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:27.459708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94230a5a-d82d-4d40-a3ad-54324180256c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:27.467574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 152/317] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:27 2021] GET /identity/v3/role_assignments?user.id=01239f23d2054667b379358167a4fa8e&scope.project.id=c97292c93fce46b1bf851f877c9530ff&role.id=ac14076037e141cc9378a1773da23f3e => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:29.688143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54409f75-ee94-48a2-b705-71f45fb8f939 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.688658 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54409f75-ee94-48a2-b705-71f45fb8f939 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.688841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54409f75-ee94-48a2-b705-71f45fb8f939 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.691375 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 166/318] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:29.697290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7ce1e-c97d-49cf-a490-9e1f73d04e79 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.697680 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7ce1e-c97d-49cf-a490-9e1f73d04e79 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.697854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7ce1e-c97d-49cf-a490-9e1f73d04e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.715562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-2ee7ce1e-c97d-49cf-a490-9e1f73d04e79 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:29.716749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2ee7ce1e-c97d-49cf-a490-9e1f73d04e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:29.725110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 153/319] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:29.734610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17834ea7-8c88-4414-a1ad-372b90898caa None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.734978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17834ea7-8c88-4414-a1ad-372b90898caa None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.735330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17834ea7-8c88-4414-a1ad-372b90898caa None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.737242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 167/320] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:29.743069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b9fe-d118-4240-a731-60a78e579770 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.743357 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b9fe-d118-4240-a731-60a78e579770 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.743634 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b9fe-d118-4240-a731-60a78e579770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.749817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17834ea7-8c88-4414-a1ad-372b90898caa None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:29.762648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d693b9fe-d118-4240-a731-60a78e579770 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:29.763834 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d693b9fe-d118-4240-a731-60a78e579770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:29.764438 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17834ea7-8c88-4414-a1ad-372b90898caa None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:29.770209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3f42f-dd37-476d-a1fb-c17308ae1526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:29.771711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f42f-dd37-476d-a1fb-c17308ae1526 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.772202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f42f-dd37-476d-a1fb-c17308ae1526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.772681 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f42f-dd37-476d-a1fb-c17308ae1526 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.774504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 154/321] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:29.784108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3f42f-dd37-476d-a1fb-c17308ae1526 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:29.787585 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d033-7301-45df-9a98-de36f57bdc7d None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.787870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d033-7301-45df-9a98-de36f57bdc7d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.788143 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d033-7301-45df-9a98-de36f57bdc7d None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.789990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 155/322] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:29.791208 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-70c3f42f-dd37-476d-a1fb-c17308ae1526 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:29.797320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 168/323] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:29.797320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3f42f-dd37-476d-a1fb-c17308ae1526 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:29.797523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756e751-c374-49a6-bf62-84e46db25a33 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.797523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756e751-c374-49a6-bf62-84e46db25a33 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.797523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756e751-c374-49a6-bf62-84e46db25a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.808286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3f42f-dd37-476d-a1fb-c17308ae1526 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:29.812608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92edd8-c208-420e-abc0-a0919dadbac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:29.813392 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92edd8-c208-420e-abc0-a0919dadbac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.813671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92edd8-c208-420e-abc0-a0919dadbac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.818075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92edd8-c208-420e-abc0-a0919dadbac1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.818075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92edd8-c208-420e-abc0-a0919dadbac1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:29.818343 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e756e751-c374-49a6-bf62-84e46db25a33 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:29.818502 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92edd8-c208-420e-abc0-a0919dadbac1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:29.819353 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 169/324] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:29.819682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e756e751-c374-49a6-bf62-84e46db25a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:29.821404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92edd8-c208-420e-abc0-a0919dadbac1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:29.828593 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 156/325] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:29.829375 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756e751-c374-49a6-bf62-84e46db25a33 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:29.835906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92edd8-c208-420e-abc0-a0919dadbac1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:29.842839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2579b-58da-4a3e-bded-3b7e64705468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:29.842977 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756e751-c374-49a6-bf62-84e46db25a33 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:29.843093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2579b-58da-4a3e-bded-3b7e64705468 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.843093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2579b-58da-4a3e-bded-3b7e64705468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.843093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2579b-58da-4a3e-bded-3b7e64705468 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.843093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2579b-58da-4a3e-bded-3b7e64705468 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:29.843093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2579b-58da-4a3e-bded-3b7e64705468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:29.844118 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2579b-58da-4a3e-bded-3b7e64705468 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:29.851849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034a605-0fc1-470a-aa58-45e7f4f77f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:29.852652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a605-0fc1-470a-aa58-45e7f4f77f5b admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.852936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a605-0fc1-470a-aa58-45e7f4f77f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.853239 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a605-0fc1-470a-aa58-45e7f4f77f5b admin admin] PATH_INFO: `/v3/groups` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.853948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034a605-0fc1-470a-aa58-45e7f4f77f5b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:29.858892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 170/326] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:29.858892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2579b-58da-4a3e-bded-3b7e64705468 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:29.859122 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034a605-0fc1-470a-aa58-45e7f4f77f5b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:29.866690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2579b-58da-4a3e-bded-3b7e64705468 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:29.871039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 157/327] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Dec 9 00:56:29 2021] POST /identity/v3/groups => generated 226 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:56:29.871160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7c70e-f40d-4ac0-8ae3-802e3165cca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:29.871900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7c70e-f40d-4ac0-8ae3-802e3165cca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.872207 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7c70e-f40d-4ac0-8ae3-802e3165cca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.872436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034a605-0fc1-470a-aa58-45e7f4f77f5b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:29.872545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7c70e-f40d-4ac0-8ae3-802e3165cca0 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.886476 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7c70e-f40d-4ac0-8ae3-802e3165cca0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:29.886991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034a605-0fc1-470a-aa58-45e7f4f77f5b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:29.891725 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d275b12-600c-4cb4-b6c7-305837cc7181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:29.892665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d275b12-600c-4cb4-b6c7-305837cc7181 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.893006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d275b12-600c-4cb4-b6c7-305837cc7181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.893478 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d275b12-600c-4cb4-b6c7-305837cc7181 admin admin] PATH_INFO: `/v3/users/8a4eeafa74e74ecfb1994e14cc219ca8` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.893854 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-21f7c70e-f40d-4ac0-8ae3-802e3165cca0 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 09 00:56:29.895007 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d275b12-600c-4cb4-b6c7-305837cc7181 admin admin] RBAC: Authorizing `identity:get_user(user_id=8a4eeafa74e74ecfb1994e14cc219ca8)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:29.895137 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 171/328] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:29 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:29.897474 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d275b12-600c-4cb4-b6c7-305837cc7181 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:29.900720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 158/329] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:29 2021] GET /identity/v3/users/8a4eeafa74e74ecfb1994e14cc219ca8 => generated 293 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:29.901591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7c70e-f40d-4ac0-8ae3-802e3165cca0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:29.905558 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d275b12-600c-4cb4-b6c7-305837cc7181 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:29.913011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7c70e-f40d-4ac0-8ae3-802e3165cca0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:29.916003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d275b12-600c-4cb4-b6c7-305837cc7181 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:29.917602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047aac2-6789-4369-a6e8-95cbb9b7faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:29.918290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047aac2-6789-4369-a6e8-95cbb9b7faf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.918589 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047aac2-6789-4369-a6e8-95cbb9b7faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.918879 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047aac2-6789-4369-a6e8-95cbb9b7faf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.919643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047aac2-6789-4369-a6e8-95cbb9b7faf3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:29.919955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047aac2-6789-4369-a6e8-95cbb9b7faf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:29.920901 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb45a41-4de6-4083-86e6-b6d36bfaab72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:29.921559 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb45a41-4de6-4083-86e6-b6d36bfaab72 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.921655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047aac2-6789-4369-a6e8-95cbb9b7faf3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:29.921845 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb45a41-4de6-4083-86e6-b6d36bfaab72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.922122 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb45a41-4de6-4083-86e6-b6d36bfaab72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.923159 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb45a41-4de6-4083-86e6-b6d36bfaab72 admin admin] RBAC: Adding query filter params (role.id=800b8a36452a418b82e9e25cef933520, user.id=8a4eeafa74e74ecfb1994e14cc219ca8, scope.system=all) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:29.923290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb45a41-4de6-4083-86e6-b6d36bfaab72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:29.925956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb45a41-4de6-4083-86e6-b6d36bfaab72 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:29.934428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 172/330] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:29 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:29.941451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047aac2-6789-4369-a6e8-95cbb9b7faf3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:29.947170 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 159/331] 10.222.0.23 () {56 vars in 1329 bytes} [Thu Dec 9 00:56:29 2021] GET /identity/v3/role_assignments?user.id=8a4eeafa74e74ecfb1994e14cc219ca8&scope.system=all&role.id=800b8a36452a418b82e9e25cef933520 => generated 510 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:29.955403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047aac2-6789-4369-a6e8-95cbb9b7faf3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:29.960111 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbb390-6feb-49a5-ac75-d758c01d422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:29.961020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbb390-6feb-49a5-ac75-d758c01d422d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.961302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbb390-6feb-49a5-ac75-d758c01d422d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.961576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbb390-6feb-49a5-ac75-d758c01d422d admin admin] PATH_INFO: `/v3/users/9a84bfeab3b44d95aaac49c563c397fe` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.963007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbb390-6feb-49a5-ac75-d758c01d422d admin admin] RBAC: Authorizing `identity:get_user(user_id=9a84bfeab3b44d95aaac49c563c397fe)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:29.965283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbb390-6feb-49a5-ac75-d758c01d422d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:29.967348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 173/332] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:29 2021] GET /identity/v3/users/9a84bfeab3b44d95aaac49c563c397fe => generated 293 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:29.973997 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb45a41-4de6-4083-86e6-b6d36bfaab72 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:29.984272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb45a41-4de6-4083-86e6-b6d36bfaab72 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:29.989652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509f010-c3c2-4d9c-b175-0b3ba53e36ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:29.990580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509f010-c3c2-4d9c-b175-0b3ba53e36ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:29.990864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509f010-c3c2-4d9c-b175-0b3ba53e36ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:29.991142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509f010-c3c2-4d9c-b175-0b3ba53e36ae admin admin] PATH_INFO: `/v3/system/users/9a84bfeab3b44d95aaac49c563c397fe/roles/ac14076037e141cc9378a1773da23f3e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:29.992795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509f010-c3c2-4d9c-b175-0b3ba53e36ae admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9a84bfeab3b44d95aaac49c563c397fe, role_id=ac14076037e141cc9378a1773da23f3e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:29.993839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-1509f010-c3c2-4d9c-b175-0b3ba53e36ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:29.993839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:56:29.993839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:56:29.994795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509f010-c3c2-4d9c-b175-0b3ba53e36ae admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:30.006905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 160/333] 10.222.0.23 () {58 vars in 1355 bytes} [Thu Dec 9 00:56:29 2021] PUT /identity/v3/system/users/9a84bfeab3b44d95aaac49c563c397fe/roles/ac14076037e141cc9378a1773da23f3e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:32.688316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedfe27-b7b7-4eee-a022-dfc01a7c8591 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:32.688885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedfe27-b7b7-4eee-a022-dfc01a7c8591 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:32.688885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedfe27-b7b7-4eee-a022-dfc01a7c8591 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:32.691617 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 174/334] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:32.697612 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cab20f-7955-42d4-a460-ebb3cc52d616 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:32.698061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cab20f-7955-42d4-a460-ebb3cc52d616 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:32.698258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cab20f-7955-42d4-a460-ebb3cc52d616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:32.699591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a98f-3afd-4425-8571-455564a57082 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:32.699868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a98f-3afd-4425-8571-455564a57082 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:32.700140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a98f-3afd-4425-8571-455564a57082 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:32.701839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 175/335] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:32.708033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c0bf7-19fc-4785-a361-7d27802e0605 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:32.708316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c0bf7-19fc-4785-a361-7d27802e0605 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:32.708592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c0bf7-19fc-4785-a361-7d27802e0605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:32.727294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-05cab20f-7955-42d4-a460-ebb3cc52d616 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:32.728514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-05cab20f-7955-42d4-a460-ebb3cc52d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:32.739374 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2c4c0bf7-19fc-4785-a361-7d27802e0605 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:32.740599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2c4c0bf7-19fc-4785-a361-7d27802e0605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:32.744787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 161/336] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:32.751007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 176/337] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:32.781436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cab20f-7955-42d4-a460-ebb3cc52d616 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:32.788527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c0bf7-19fc-4785-a361-7d27802e0605 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:32.791449 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cab20f-7955-42d4-a460-ebb3cc52d616 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:32.801025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c0bf7-19fc-4785-a361-7d27802e0605 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:32.802296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cddb23-1e71-4f8b-b4b1-db4bf0308ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:32.803218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cddb23-1e71-4f8b-b4b1-db4bf0308ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:32.803431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cddb23-1e71-4f8b-b4b1-db4bf0308ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:32.803708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cddb23-1e71-4f8b-b4b1-db4bf0308ac9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:32.807067 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6acb98-cd97-441c-bf9f-26ccaab1548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:32.807851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6acb98-cd97-441c-bf9f-26ccaab1548c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:32.808133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6acb98-cd97-441c-bf9f-26ccaab1548c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:32.808403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6acb98-cd97-441c-bf9f-26ccaab1548c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:32.831430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cddb23-1e71-4f8b-b4b1-db4bf0308ac9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:32.835333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6acb98-cd97-441c-bf9f-26ccaab1548c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:32.838915 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-92cddb23-1e71-4f8b-b4b1-db4bf0308ac9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:32.846515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 162/338] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:32.855715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cddb23-1e71-4f8b-b4b1-db4bf0308ac9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:32.859281 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-8a6acb98-cd97-441c-bf9f-26ccaab1548c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 09 00:56:32.860668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 177/339] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:32 2021] GET /identity/v3/roles/reader => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:32.874258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cddb23-1e71-4f8b-b4b1-db4bf0308ac9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:32.876249 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6acb98-cd97-441c-bf9f-26ccaab1548c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:32.884907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733c948-5d14-440d-b575-d7a6739bb3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:32.885574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733c948-5d14-440d-b575-d7a6739bb3ff admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:32.885855 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733c948-5d14-440d-b575-d7a6739bb3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:32.886128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733c948-5d14-440d-b575-d7a6739bb3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:32.886916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733c948-5d14-440d-b575-d7a6739bb3ff admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:32.887218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733c948-5d14-440d-b575-d7a6739bb3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:32.888810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733c948-5d14-440d-b575-d7a6739bb3ff admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:32.891363 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6acb98-cd97-441c-bf9f-26ccaab1548c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:32.900718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea324d08-0fb6-4ae5-831c-fa3cc3ba47ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:32.901391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea324d08-0fb6-4ae5-831c-fa3cc3ba47ff admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:32.901675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea324d08-0fb6-4ae5-831c-fa3cc3ba47ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:32.901950 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea324d08-0fb6-4ae5-831c-fa3cc3ba47ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:32.902739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea324d08-0fb6-4ae5-831c-fa3cc3ba47ff admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:32.903051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea324d08-0fb6-4ae5-831c-fa3cc3ba47ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:32.904640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea324d08-0fb6-4ae5-831c-fa3cc3ba47ff admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:32.905800 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 163/340] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:32.911886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733c948-5d14-440d-b575-d7a6739bb3ff admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:32.921832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 178/341] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:32 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:32.931348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea324d08-0fb6-4ae5-831c-fa3cc3ba47ff admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:32.932201 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733c948-5d14-440d-b575-d7a6739bb3ff admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:32.947693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea324d08-0fb6-4ae5-831c-fa3cc3ba47ff admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:32.948444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908b74b-e021-4be9-92fe-2ced3d596dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:32.949098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908b74b-e021-4be9-92fe-2ced3d596dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:32.949376 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908b74b-e021-4be9-92fe-2ced3d596dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:32.949649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908b74b-e021-4be9-92fe-2ced3d596dcd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:32.966126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908b74b-e021-4be9-92fe-2ced3d596dcd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:32.967904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908b74b-e021-4be9-92fe-2ced3d596dcd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:32.972426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664386c9-b218-4e52-9c50-ed02218af30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:32.973316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664386c9-b218-4e52-9c50-ed02218af30a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:32.973600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664386c9-b218-4e52-9c50-ed02218af30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:32.973883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664386c9-b218-4e52-9c50-ed02218af30a admin admin] PATH_INFO: `/v3/users/9a84bfeab3b44d95aaac49c563c397fe` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:32.979162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664386c9-b218-4e52-9c50-ed02218af30a admin admin] RBAC: Authorizing `identity:get_user(user_id=9a84bfeab3b44d95aaac49c563c397fe)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:32.981302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664386c9-b218-4e52-9c50-ed02218af30a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:32.981495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 164/342] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 09 00:56:32.983107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 179/343] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:56:32 2021] GET /identity/v3/users/9a84bfeab3b44d95aaac49c563c397fe => generated 293 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:32.988321 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908b74b-e021-4be9-92fe-2ced3d596dcd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:32.996161 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664386c9-b218-4e52-9c50-ed02218af30a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.004782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908b74b-e021-4be9-92fe-2ced3d596dcd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.011397 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664386c9-b218-4e52-9c50-ed02218af30a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.019967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d8161-258f-4628-b656-39070791d444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.020832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d8161-258f-4628-b656-39070791d444 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.021107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d8161-258f-4628-b656-39070791d444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.021378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d8161-258f-4628-b656-39070791d444 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.023734 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d8161-258f-4628-b656-39070791d444 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.024437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df38305-2ddd-4867-b6a3-1c1cc8a30c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.025097 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df38305-2ddd-4867-b6a3-1c1cc8a30c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.025379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df38305-2ddd-4867-b6a3-1c1cc8a30c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.025657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df38305-2ddd-4867-b6a3-1c1cc8a30c8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.025826 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d8161-258f-4628-b656-39070791d444 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:33.026521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df38305-2ddd-4867-b6a3-1c1cc8a30c8f admin admin] RBAC: Adding query filter params (role.id=ac14076037e141cc9378a1773da23f3e, user.id=9a84bfeab3b44d95aaac49c563c397fe, scope.system=all) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:33.026844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df38305-2ddd-4867-b6a3-1c1cc8a30c8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.028549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 165/344] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:32 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:33.028743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df38305-2ddd-4867-b6a3-1c1cc8a30c8f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:33.033398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d8161-258f-4628-b656-39070791d444 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.052939 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d8161-258f-4628-b656-39070791d444 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.059450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 180/345] 10.222.0.23 () {56 vars in 1329 bytes} [Thu Dec 9 00:56:32 2021] GET /identity/v3/role_assignments?user.id=9a84bfeab3b44d95aaac49c563c397fe&scope.system=all&role.id=ac14076037e141cc9378a1773da23f3e => generated 510 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:33.061268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1eabc-5d90-4c42-9f29-493a5130a75b None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.061551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1eabc-5d90-4c42-9f29-493a5130a75b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.061829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1eabc-5d90-4c42-9f29-493a5130a75b None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.063833 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 181/346] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:33.067111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac0029-ca38-4c3c-a5b0-8722ceb362b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.068062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac0029-ca38-4c3c-a5b0-8722ceb362b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.068426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac0029-ca38-4c3c-a5b0-8722ceb362b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.068706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac0029-ca38-4c3c-a5b0-8722ceb362b1 admin admin] PATH_INFO: `/v3/groups/842f42d3b1084b529b150d8bf78c00d7` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.072532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93759650-ed4b-4734-8e39-ce421e2e42ee None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.072808 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93759650-ed4b-4734-8e39-ce421e2e42ee None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.073082 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93759650-ed4b-4734-8e39-ce421e2e42ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.081211 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac0029-ca38-4c3c-a5b0-8722ceb362b1 admin admin] RBAC: Authorizing `identity:get_group(group_id=842f42d3b1084b529b150d8bf78c00d7)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.082245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-adac0029-ca38-4c3c-a5b0-8722ceb362b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:33.082245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:56:33.082245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:56:33.083485 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac0029-ca38-4c3c-a5b0-8722ceb362b1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:33.085438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 166/347] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/groups/842f42d3b1084b529b150d8bf78c00d7 => generated 226 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:33.093241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac0029-ca38-4c3c-a5b0-8722ceb362b1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.117172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-93759650-ed4b-4734-8e39-ce421e2e42ee None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:33.118462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-93759650-ed4b-4734-8e39-ce421e2e42ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:33.121623 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac0029-ca38-4c3c-a5b0-8722ceb362b1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.133892 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88d56-b9b5-4fff-bb76-5e09cf2567f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.134597 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88d56-b9b5-4fff-bb76-5e09cf2567f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.134877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88d56-b9b5-4fff-bb76-5e09cf2567f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.135150 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88d56-b9b5-4fff-bb76-5e09cf2567f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.136020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88d56-b9b5-4fff-bb76-5e09cf2567f9 admin admin] RBAC: Adding query filter params (group.id=842f42d3b1084b529b150d8bf78c00d7, role.id=1dbfc98083ce41ea943fbb3de6be133e, scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:33.136333 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88d56-b9b5-4fff-bb76-5e09cf2567f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.138275 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88d56-b9b5-4fff-bb76-5e09cf2567f9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:33.153586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 182/348] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:33.155701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 167/349] 10.222.0.23 () {56 vars in 1397 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/role_assignments?group.id=842f42d3b1084b529b150d8bf78c00d7&scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b&role.id=1dbfc98083ce41ea943fbb3de6be133e => generated 260 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:33.197546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93759650-ed4b-4734-8e39-ce421e2e42ee None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.207300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93759650-ed4b-4734-8e39-ce421e2e42ee None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.214719 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182ef01-8800-4975-88ef-dff9a4eb5dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.215537 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182ef01-8800-4975-88ef-dff9a4eb5dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.215818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182ef01-8800-4975-88ef-dff9a4eb5dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.216086 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182ef01-8800-4975-88ef-dff9a4eb5dc7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.230000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182ef01-8800-4975-88ef-dff9a4eb5dc7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:33.237592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-1182ef01-8800-4975-88ef-dff9a4eb5dc7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:33.238921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 183/350] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:33.245308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88d56-b9b5-4fff-bb76-5e09cf2567f9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.256169 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88d56-b9b5-4fff-bb76-5e09cf2567f9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.261136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba168773-f9a6-42f8-95d8-ae9fe229fecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.261817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba168773-f9a6-42f8-95d8-ae9fe229fecd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.262096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba168773-f9a6-42f8-95d8-ae9fe229fecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.262402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba168773-f9a6-42f8-95d8-ae9fe229fecd admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.263176 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba168773-f9a6-42f8-95d8-ae9fe229fecd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:33.263483 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba168773-f9a6-42f8-95d8-ae9fe229fecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.265130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba168773-f9a6-42f8-95d8-ae9fe229fecd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:33.278746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 168/351] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:33.285546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182ef01-8800-4975-88ef-dff9a4eb5dc7 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.300042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182ef01-8800-4975-88ef-dff9a4eb5dc7 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.304775 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cd933-7efc-4eb9-a199-3fc75635cce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.305432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cd933-7efc-4eb9-a199-3fc75635cce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.305707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cd933-7efc-4eb9-a199-3fc75635cce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.306045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cd933-7efc-4eb9-a199-3fc75635cce6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.320350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cd933-7efc-4eb9-a199-3fc75635cce6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.322123 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cd933-7efc-4eb9-a199-3fc75635cce6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:33.334873 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 184/352] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:33.341304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba168773-f9a6-42f8-95d8-ae9fe229fecd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.355718 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba168773-f9a6-42f8-95d8-ae9fe229fecd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.360523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd4f7-dc88-446d-b847-f726b89874c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.361444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd4f7-dc88-446d-b847-f726b89874c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.361780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd4f7-dc88-446d-b847-f726b89874c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.362004 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd4f7-dc88-446d-b847-f726b89874c2 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.367309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd4f7-dc88-446d-b847-f726b89874c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.369378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd4f7-dc88-446d-b847-f726b89874c2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:33.371348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 169/353] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:33.377966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cd933-7efc-4eb9-a199-3fc75635cce6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.390455 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cd933-7efc-4eb9-a199-3fc75635cce6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.395104 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959676c-9164-47b1-8b60-867fcb3f6a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.395954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959676c-9164-47b1-8b60-867fcb3f6a0a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.396410 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959676c-9164-47b1-8b60-867fcb3f6a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.396690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959676c-9164-47b1-8b60-867fcb3f6a0a admin admin] PATH_INFO: `/v3/groups/842f42d3b1084b529b150d8bf78c00d7` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.399326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959676c-9164-47b1-8b60-867fcb3f6a0a admin admin] RBAC: Authorizing `identity:get_group(group_id=842f42d3b1084b529b150d8bf78c00d7)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.400348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-c959676c-9164-47b1-8b60-867fcb3f6a0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:33.400348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:56:33.400348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:56:33.401520 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959676c-9164-47b1-8b60-867fcb3f6a0a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:33.403510 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 185/354] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/groups/842f42d3b1084b529b150d8bf78c00d7 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:33.410315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd4f7-dc88-446d-b847-f726b89874c2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.420202 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd4f7-dc88-446d-b847-f726b89874c2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.426298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc614497-7b6f-4d1f-8691-e61691cee13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.426980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc614497-7b6f-4d1f-8691-e61691cee13b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.427259 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc614497-7b6f-4d1f-8691-e61691cee13b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.427532 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc614497-7b6f-4d1f-8691-e61691cee13b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.428372 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc614497-7b6f-4d1f-8691-e61691cee13b admin admin] RBAC: Adding query filter params (group.id=842f42d3b1084b529b150d8bf78c00d7, role.id=800b8a36452a418b82e9e25cef933520, scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:33.428681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc614497-7b6f-4d1f-8691-e61691cee13b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.430546 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc614497-7b6f-4d1f-8691-e61691cee13b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:33.442774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 170/355] 10.222.0.23 () {56 vars in 1397 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/role_assignments?group.id=842f42d3b1084b529b150d8bf78c00d7&scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b&role.id=800b8a36452a418b82e9e25cef933520 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:33.740907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08f12-43b9-4ff4-a17d-0fd41166cf88 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.741587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08f12-43b9-4ff4-a17d-0fd41166cf88 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.741587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee08f12-43b9-4ff4-a17d-0fd41166cf88 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.743530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 186/356] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:33.749293 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bc601-5e1d-45e2-88b8-572c35809e28 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.749839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bc601-5e1d-45e2-88b8-572c35809e28 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.749839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bc601-5e1d-45e2-88b8-572c35809e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.769334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-ed3bc601-5e1d-45e2-88b8-572c35809e28 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:33.771443 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ed3bc601-5e1d-45e2-88b8-572c35809e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:33.779688 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 171/357] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:33.807066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee08f12-43b9-4ff4-a17d-0fd41166cf88 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.822157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee08f12-43b9-4ff4-a17d-0fd41166cf88 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.826874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c907118-21fd-46ec-bd41-4b037d8e0a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.827916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c907118-21fd-46ec-bd41-4b037d8e0a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.828404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c907118-21fd-46ec-bd41-4b037d8e0a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.828891 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c907118-21fd-46ec-bd41-4b037d8e0a9b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.840942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c907118-21fd-46ec-bd41-4b037d8e0a9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:33.848514 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-4c907118-21fd-46ec-bd41-4b037d8e0a9b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:33.854383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 187/358] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:33.856516 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bc601-5e1d-45e2-88b8-572c35809e28 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.867671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bc601-5e1d-45e2-88b8-572c35809e28 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.872137 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cec7b-5878-4c22-bef1-0a1fef3967e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.872801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cec7b-5878-4c22-bef1-0a1fef3967e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.873086 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cec7b-5878-4c22-bef1-0a1fef3967e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.873364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cec7b-5878-4c22-bef1-0a1fef3967e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.874127 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cec7b-5878-4c22-bef1-0a1fef3967e9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:33.874453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cec7b-5878-4c22-bef1-0a1fef3967e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.876042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cec7b-5878-4c22-bef1-0a1fef3967e9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:33.889788 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 172/359] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:33.896356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c907118-21fd-46ec-bd41-4b037d8e0a9b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.906257 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c907118-21fd-46ec-bd41-4b037d8e0a9b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.914917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb20ff6-0874-408d-bcd7-bed1fc050d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.915590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb20ff6-0874-408d-bcd7-bed1fc050d4f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.915876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb20ff6-0874-408d-bcd7-bed1fc050d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.916153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb20ff6-0874-408d-bcd7-bed1fc050d4f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.925663 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb20ff6-0874-408d-bcd7-bed1fc050d4f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.927439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb20ff6-0874-408d-bcd7-bed1fc050d4f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:33.936790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 188/360] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:33.943889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cec7b-5878-4c22-bef1-0a1fef3967e9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.954821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cec7b-5878-4c22-bef1-0a1fef3967e9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.959676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f6032-26c3-4ffe-9961-78fa8d5c4e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.960716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6032-26c3-4ffe-9961-78fa8d5c4e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.961159 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6032-26c3-4ffe-9961-78fa8d5c4e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.961587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6032-26c3-4ffe-9961-78fa8d5c4e83 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.962974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f6032-26c3-4ffe-9961-78fa8d5c4e83 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.965164 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f6032-26c3-4ffe-9961-78fa8d5c4e83 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:33.967052 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 173/361] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:33.974524 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb20ff6-0874-408d-bcd7-bed1fc050d4f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:33.984954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb20ff6-0874-408d-bcd7-bed1fc050d4f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:33.994087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d8b72-607c-48d7-a089-abe07ccdbf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:33.995171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d8b72-607c-48d7-a089-abe07ccdbf7d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:33.995628 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d8b72-607c-48d7-a089-abe07ccdbf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:33.996054 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d8b72-607c-48d7-a089-abe07ccdbf7d admin admin] PATH_INFO: `/v3/groups/842f42d3b1084b529b150d8bf78c00d7` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:33.997405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d8b72-607c-48d7-a089-abe07ccdbf7d admin admin] RBAC: Authorizing `identity:get_group(group_id=842f42d3b1084b529b150d8bf78c00d7)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:33.999488 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d8b72-607c-48d7-a089-abe07ccdbf7d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:34.001243 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 189/362] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:33 2021] GET /identity/v3/groups/842f42d3b1084b529b150d8bf78c00d7 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:34.008192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f6032-26c3-4ffe-9961-78fa8d5c4e83 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:34.019444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f6032-26c3-4ffe-9961-78fa8d5c4e83 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:34.024058 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbea34-714f-4460-b1cd-0ac133402928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:34.024867 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbea34-714f-4460-b1cd-0ac133402928 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:34.025331 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbea34-714f-4460-b1cd-0ac133402928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:34.025752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbea34-714f-4460-b1cd-0ac133402928 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:34.026771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbea34-714f-4460-b1cd-0ac133402928 admin admin] RBAC: Adding query filter params (group.id=842f42d3b1084b529b150d8bf78c00d7, role.id=800b8a36452a418b82e9e25cef933520, scope.project.id=c97292c93fce46b1bf851f877c9530ff) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:34.027230 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbea34-714f-4460-b1cd-0ac133402928 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:34.029216 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbea34-714f-4460-b1cd-0ac133402928 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:34.038547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 174/363] 10.222.0.23 () {56 vars in 1397 bytes} [Thu Dec 9 00:56:34 2021] GET /identity/v3/role_assignments?group.id=842f42d3b1084b529b150d8bf78c00d7&scope.project.id=c97292c93fce46b1bf851f877c9530ff&role.id=800b8a36452a418b82e9e25cef933520 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:34.748700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729d1e7-dbce-4323-9c5c-1f95238ec8d5 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:34.749249 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729d1e7-dbce-4323-9c5c-1f95238ec8d5 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:34.749249 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729d1e7-dbce-4323-9c5c-1f95238ec8d5 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:34.751325 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 190/364] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:34.757773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703e166-5151-4fa3-a6c7-e553ae42f179 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:34.758246 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703e166-5151-4fa3-a6c7-e553ae42f179 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:34.758324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703e166-5151-4fa3-a6c7-e553ae42f179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:34.780714 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b703e166-5151-4fa3-a6c7-e553ae42f179 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:34.781909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b703e166-5151-4fa3-a6c7-e553ae42f179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:34.797081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 175/365] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:34.839847 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729d1e7-dbce-4323-9c5c-1f95238ec8d5 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:34.859261 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729d1e7-dbce-4323-9c5c-1f95238ec8d5 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:34.866429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e66d5-1d17-4c3c-a9c8-ae86e0d57bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:34.867261 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e66d5-1d17-4c3c-a9c8-ae86e0d57bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:34.867539 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e66d5-1d17-4c3c-a9c8-ae86e0d57bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:34.867814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e66d5-1d17-4c3c-a9c8-ae86e0d57bb7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:34.886518 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e66d5-1d17-4c3c-a9c8-ae86e0d57bb7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:34.894180 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-879e66d5-1d17-4c3c-a9c8-ae86e0d57bb7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:34.899692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 191/366] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:34.902576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703e166-5151-4fa3-a6c7-e553ae42f179 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:34.917852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703e166-5151-4fa3-a6c7-e553ae42f179 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:34.932381 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde7b95-ca5c-4c27-9cde-6a8c9f620c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:34.933352 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde7b95-ca5c-4c27-9cde-6a8c9f620c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:34.933827 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde7b95-ca5c-4c27-9cde-6a8c9f620c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:34.934280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde7b95-ca5c-4c27-9cde-6a8c9f620c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:34.935244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde7b95-ca5c-4c27-9cde-6a8c9f620c84 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:34.935739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde7b95-ca5c-4c27-9cde-6a8c9f620c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:34.937494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde7b95-ca5c-4c27-9cde-6a8c9f620c84 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:34.951680 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 176/367] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:34.958182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e66d5-1d17-4c3c-a9c8-ae86e0d57bb7 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:34.971372 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e66d5-1d17-4c3c-a9c8-ae86e0d57bb7 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:34.977677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a657dc3-8d9e-45a4-970d-4ee7326098f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:34.978599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a657dc3-8d9e-45a4-970d-4ee7326098f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:34.979064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0a60b-172c-4491-9880-c64b6d35c209 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:34.979270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a657dc3-8d9e-45a4-970d-4ee7326098f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:34.979366 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0a60b-172c-4491-9880-c64b6d35c209 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:34.979617 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0a60b-172c-4491-9880-c64b6d35c209 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:34.979992 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a657dc3-8d9e-45a4-970d-4ee7326098f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:34.981644 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 177/368] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:34.987033 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82768a-28c9-4895-9d5e-efda38586915 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:34.987833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82768a-28c9-4895-9d5e-efda38586915 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:34.988310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82768a-28c9-4895-9d5e-efda38586915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:34.992753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a657dc3-8d9e-45a4-970d-4ee7326098f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:34.994615 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a657dc3-8d9e-45a4-970d-4ee7326098f5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:35.006945 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 192/369] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:35.012979 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a657dc3-8d9e-45a4-970d-4ee7326098f5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:35.013266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-7c82768a-28c9-4895-9d5e-efda38586915 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:35.014727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7c82768a-28c9-4895-9d5e-efda38586915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:35.024757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a657dc3-8d9e-45a4-970d-4ee7326098f5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:35.033273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 178/370] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:35.035093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4a85c-b204-47f4-8cf8-22b2e1d25481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:35.036134 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4a85c-b204-47f4-8cf8-22b2e1d25481 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:35.036564 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4a85c-b204-47f4-8cf8-22b2e1d25481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:35.036985 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4a85c-b204-47f4-8cf8-22b2e1d25481 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:35.038415 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4a85c-b204-47f4-8cf8-22b2e1d25481 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:35.040900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4a85c-b204-47f4-8cf8-22b2e1d25481 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:35.043189 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 193/371] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:35 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:35.049815 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82768a-28c9-4895-9d5e-efda38586915 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:35.063540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82768a-28c9-4895-9d5e-efda38586915 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:35.068445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93903cb-0bde-4a71-811b-f6a33d053355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:35.069353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93903cb-0bde-4a71-811b-f6a33d053355 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:35.069646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93903cb-0bde-4a71-811b-f6a33d053355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:35.069927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93903cb-0bde-4a71-811b-f6a33d053355 admin admin] PATH_INFO: `/v3/groups/842f42d3b1084b529b150d8bf78c00d7` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:35.071151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93903cb-0bde-4a71-811b-f6a33d053355 admin admin] RBAC: Authorizing `identity:get_group(group_id=842f42d3b1084b529b150d8bf78c00d7)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:35.071266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4a85c-b204-47f4-8cf8-22b2e1d25481 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:35.073124 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93903cb-0bde-4a71-811b-f6a33d053355 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:35.077114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 179/372] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:35 2021] GET /identity/v3/groups/842f42d3b1084b529b150d8bf78c00d7 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:35.087472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4a85c-b204-47f4-8cf8-22b2e1d25481 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:35.091704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93903cb-0bde-4a71-811b-f6a33d053355 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:35.094580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa97af-f6ab-45b9-b2a4-b09a9c4f544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:35.095658 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa97af-f6ab-45b9-b2a4-b09a9c4f544c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:35.096130 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa97af-f6ab-45b9-b2a4-b09a9c4f544c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:35.096597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa97af-f6ab-45b9-b2a4-b09a9c4f544c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:35.107655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93903cb-0bde-4a71-811b-f6a33d053355 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:35.117971 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a24bf-295a-404c-9d6e-b5d5b2588475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:35.118892 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a24bf-295a-404c-9d6e-b5d5b2588475 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:35.119612 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a24bf-295a-404c-9d6e-b5d5b2588475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:35.120288 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa97af-f6ab-45b9-b2a4-b09a9c4f544c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:35.120761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a24bf-295a-404c-9d6e-b5d5b2588475 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:35.127839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a24bf-295a-404c-9d6e-b5d5b2588475 admin admin] RBAC: Adding query filter params (group.id=842f42d3b1084b529b150d8bf78c00d7, role.id=1dbfc98083ce41ea943fbb3de6be133e, scope.project.id=c97292c93fce46b1bf851f877c9530ff) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:35.128163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a24bf-295a-404c-9d6e-b5d5b2588475 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:35.128460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-b2fa97af-f6ab-45b9-b2a4-b09a9c4f544c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:56:35.130164 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a24bf-295a-404c-9d6e-b5d5b2588475 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:35.130411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 194/373] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:56:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:35.135946 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa97af-f6ab-45b9-b2a4-b09a9c4f544c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:35.138265 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 180/374] 10.222.0.23 () {56 vars in 1397 bytes} [Thu Dec 9 00:56:35 2021] GET /identity/v3/role_assignments?group.id=842f42d3b1084b529b150d8bf78c00d7&scope.project.id=c97292c93fce46b1bf851f877c9530ff&role.id=1dbfc98083ce41ea943fbb3de6be133e => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:35.151765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa97af-f6ab-45b9-b2a4-b09a9c4f544c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:35.161765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8c104-7786-4e36-bc38-2196c6434092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:35.162750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8c104-7786-4e36-bc38-2196c6434092 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:35.163195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8c104-7786-4e36-bc38-2196c6434092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:35.163618 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8c104-7786-4e36-bc38-2196c6434092 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:35.164531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8c104-7786-4e36-bc38-2196c6434092 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:35.164984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8c104-7786-4e36-bc38-2196c6434092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:35.166789 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8c104-7786-4e36-bc38-2196c6434092 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:35.186233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 195/375] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:35.192900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a24bf-295a-404c-9d6e-b5d5b2588475 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:35.207112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a24bf-295a-404c-9d6e-b5d5b2588475 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:35.217683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfc54b-a681-4b1d-a736-0718a6ff4445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:35.218540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfc54b-a681-4b1d-a736-0718a6ff4445 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:35.218925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfc54b-a681-4b1d-a736-0718a6ff4445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:35.219304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfc54b-a681-4b1d-a736-0718a6ff4445 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:35.230330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfc54b-a681-4b1d-a736-0718a6ff4445 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:35.232322 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfc54b-a681-4b1d-a736-0718a6ff4445 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:35.248808 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 181/376] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:35.255994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8c104-7786-4e36-bc38-2196c6434092 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:35.272847 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8c104-7786-4e36-bc38-2196c6434092 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:35.283473 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc93d0-668e-4bea-8bf9-e048ea9125ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:35.284610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc93d0-668e-4bea-8bf9-e048ea9125ab admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:35.285041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc93d0-668e-4bea-8bf9-e048ea9125ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:35.285461 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc93d0-668e-4bea-8bf9-e048ea9125ab admin admin] PATH_INFO: `/v3/projects/190e540339684142b1a25d3f47e2a0ee` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:35.286857 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc93d0-668e-4bea-8bf9-e048ea9125ab admin admin] RBAC: Authorizing `identity:get_project(project_id=190e540339684142b1a25d3f47e2a0ee)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:35.288824 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc93d0-668e-4bea-8bf9-e048ea9125ab admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:35.290720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 196/377] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:35 2021] GET /identity/v3/projects/190e540339684142b1a25d3f47e2a0ee => generated 344 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:35.297665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfc54b-a681-4b1d-a736-0718a6ff4445 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:35.311801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfc54b-a681-4b1d-a736-0718a6ff4445 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:35.317079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24896c11-6ffb-4225-b4a9-50b96d6af454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:35.318097 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24896c11-6ffb-4225-b4a9-50b96d6af454 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:35.318579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24896c11-6ffb-4225-b4a9-50b96d6af454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:35.319002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24896c11-6ffb-4225-b4a9-50b96d6af454 admin admin] PATH_INFO: `/v3/groups/52d1434da35a4c57860f46bfb9132d46` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:35.330802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24896c11-6ffb-4225-b4a9-50b96d6af454 admin admin] RBAC: Authorizing `identity:get_group(group_id=52d1434da35a4c57860f46bfb9132d46)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:35.332964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24896c11-6ffb-4225-b4a9-50b96d6af454 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:35.335163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 182/378] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:35 2021] GET /identity/v3/groups/52d1434da35a4c57860f46bfb9132d46 => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:35.341399 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc93d0-668e-4bea-8bf9-e048ea9125ab admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:35.351960 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc93d0-668e-4bea-8bf9-e048ea9125ab admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:35.362007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fe31a-7c09-46c8-892f-21d06779849f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:35.363261 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe31a-7c09-46c8-892f-21d06779849f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:35.363694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe31a-7c09-46c8-892f-21d06779849f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:35.364135 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe31a-7c09-46c8-892f-21d06779849f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:35.365129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fe31a-7c09-46c8-892f-21d06779849f admin admin] RBAC: Adding query filter params (group.id=52d1434da35a4c57860f46bfb9132d46, role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=190e540339684142b1a25d3f47e2a0ee) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:35.365599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fe31a-7c09-46c8-892f-21d06779849f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:35.367618 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fe31a-7c09-46c8-892f-21d06779849f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:35.379139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 197/379] 10.222.0.23 () {56 vars in 1397 bytes} [Thu Dec 9 00:56:35 2021] GET /identity/v3/role_assignments?group.id=52d1434da35a4c57860f46bfb9132d46&scope.project.id=190e540339684142b1a25d3f47e2a0ee&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:36.467393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bad918-f3dd-4f1d-891b-5b7e28aef896 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:36.467906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bad918-f3dd-4f1d-891b-5b7e28aef896 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:36.468011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bad918-f3dd-4f1d-891b-5b7e28aef896 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:36.469932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 183/380] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:36.477898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7034c05-5d2f-4f54-83fe-209455796ce2 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:36.478451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7034c05-5d2f-4f54-83fe-209455796ce2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:36.478451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7034c05-5d2f-4f54-83fe-209455796ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:36.497656 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-b7034c05-5d2f-4f54-83fe-209455796ce2 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:36.498894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b7034c05-5d2f-4f54-83fe-209455796ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:36.516551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 198/381] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:36.552214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bad918-f3dd-4f1d-891b-5b7e28aef896 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:36.567059 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bad918-f3dd-4f1d-891b-5b7e28aef896 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:36.577311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda27ed3-780d-44b0-a6b3-c724b6b5e32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:36.578112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda27ed3-780d-44b0-a6b3-c724b6b5e32c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:36.578502 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda27ed3-780d-44b0-a6b3-c724b6b5e32c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:36.578785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda27ed3-780d-44b0-a6b3-c724b6b5e32c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:36.595791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda27ed3-780d-44b0-a6b3-c724b6b5e32c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:36.602759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-cda27ed3-780d-44b0-a6b3-c724b6b5e32c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:36.604305 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 184/382] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:36.610496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7034c05-5d2f-4f54-83fe-209455796ce2 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:36.620581 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7034c05-5d2f-4f54-83fe-209455796ce2 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:36.630593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb31ef5-2105-464d-aeb3-490c0569ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:36.631270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb31ef5-2105-464d-aeb3-490c0569ee08 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:36.631554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb31ef5-2105-464d-aeb3-490c0569ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:36.631836 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb31ef5-2105-464d-aeb3-490c0569ee08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:36.632606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb31ef5-2105-464d-aeb3-490c0569ee08 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:36.632913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb31ef5-2105-464d-aeb3-490c0569ee08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:36.634554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb31ef5-2105-464d-aeb3-490c0569ee08 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:36.644351 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 199/383] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:36.650271 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda27ed3-780d-44b0-a6b3-c724b6b5e32c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:36.660903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda27ed3-780d-44b0-a6b3-c724b6b5e32c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:36.669294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5d8e7-1ab9-4c33-b742-7abb0a4d3718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:36.670148 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5d8e7-1ab9-4c33-b742-7abb0a4d3718 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:36.670461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5d8e7-1ab9-4c33-b742-7abb0a4d3718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:36.670740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5d8e7-1ab9-4c33-b742-7abb0a4d3718 admin admin] PATH_INFO: `/v3/groups/842f42d3b1084b529b150d8bf78c00d7` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:36.671958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5d8e7-1ab9-4c33-b742-7abb0a4d3718 admin admin] RBAC: Authorizing `identity:get_group(group_id=842f42d3b1084b529b150d8bf78c00d7)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:36.674436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5d8e7-1ab9-4c33-b742-7abb0a4d3718 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:36.676721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 185/384] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:36 2021] GET /identity/v3/groups/842f42d3b1084b529b150d8bf78c00d7 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:36.682639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb31ef5-2105-464d-aeb3-490c0569ee08 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:36.693123 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb31ef5-2105-464d-aeb3-490c0569ee08 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:36.702543 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973d5c7-660a-464d-946c-12df09da9b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:36.703409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973d5c7-660a-464d-946c-12df09da9b8d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:36.703692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973d5c7-660a-464d-946c-12df09da9b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:36.703966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973d5c7-660a-464d-946c-12df09da9b8d admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:36.705753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973d5c7-660a-464d-946c-12df09da9b8d admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:36.708041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973d5c7-660a-464d-946c-12df09da9b8d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:36.709749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 200/385] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:36 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:36.716185 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5d8e7-1ab9-4c33-b742-7abb0a4d3718 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:36.727001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5d8e7-1ab9-4c33-b742-7abb0a4d3718 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:36.738673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb28d8-bca6-4847-a940-c8a733e94cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:36.739579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb28d8-bca6-4847-a940-c8a733e94cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:36.739863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb28d8-bca6-4847-a940-c8a733e94cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:36.740141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb28d8-bca6-4847-a940-c8a733e94cdf admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b/groups/842f42d3b1084b529b150d8bf78c00d7/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:36.747554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb28d8-bca6-4847-a940-c8a733e94cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbc52dd5f424931a362b9a5e7697c8b, group_id=842f42d3b1084b529b150d8bf78c00d7, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:36.750256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb28d8-bca6-4847-a940-c8a733e94cdf admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:36.774077 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 186/386] 10.222.0.23 () {58 vars in 1463 bytes} [Thu Dec 9 00:56:36 2021] PUT /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b/groups/842f42d3b1084b529b150d8bf78c00d7/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:37.023634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d9095-972b-4ee6-88d6-e7fc738398a7 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.024017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d9095-972b-4ee6-88d6-e7fc738398a7 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.024209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d9095-972b-4ee6-88d6-e7fc738398a7 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.025958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 201/387] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:37.032175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61343892-0521-4f55-bc32-14b786d0f842 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.032465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61343892-0521-4f55-bc32-14b786d0f842 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.032745 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61343892-0521-4f55-bc32-14b786d0f842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.062872 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-61343892-0521-4f55-bc32-14b786d0f842 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:37.064094 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-61343892-0521-4f55-bc32-14b786d0f842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:37.139840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 187/388] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:37.175295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d9095-972b-4ee6-88d6-e7fc738398a7 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:37.183357 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8eb5a-0655-4429-b02f-3f448fc1b19c None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.184002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8eb5a-0655-4429-b02f-3f448fc1b19c None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.184477 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8eb5a-0655-4429-b02f-3f448fc1b19c None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.186865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 188/389] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:37.193850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d9095-972b-4ee6-88d6-e7fc738398a7 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:37.194256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88b377-eea0-4a41-a596-57a310978989 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.194779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88b377-eea0-4a41-a596-57a310978989 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.195250 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88b377-eea0-4a41-a596-57a310978989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.202347 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463eb734-9a6e-4b91-9432-e8831847927d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:37.204355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eb734-9a6e-4b91-9432-e8831847927d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.206081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eb734-9a6e-4b91-9432-e8831847927d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.206616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eb734-9a6e-4b91-9432-e8831847927d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.221976 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-6c88b377-eea0-4a41-a596-57a310978989 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:37.225881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-6c88b377-eea0-4a41-a596-57a310978989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:37.231930 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463eb734-9a6e-4b91-9432-e8831847927d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:37.240876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-463eb734-9a6e-4b91-9432-e8831847927d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:37.246465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 202/390] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:37.252407 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 189/391] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:37.253706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463eb734-9a6e-4b91-9432-e8831847927d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:37.264493 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463eb734-9a6e-4b91-9432-e8831847927d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:37.269826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89d422-bd1d-4310-af2e-be8163b29d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:37.270858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d422-bd1d-4310-af2e-be8163b29d42 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.271340 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d422-bd1d-4310-af2e-be8163b29d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.271856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d422-bd1d-4310-af2e-be8163b29d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.272976 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89d422-bd1d-4310-af2e-be8163b29d42 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:37.273486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89d422-bd1d-4310-af2e-be8163b29d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:37.275589 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89d422-bd1d-4310-af2e-be8163b29d42 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:37.277978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88b377-eea0-4a41-a596-57a310978989 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:37.289437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 203/392] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:37.292672 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88b377-eea0-4a41-a596-57a310978989 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:37.298560 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89d422-bd1d-4310-af2e-be8163b29d42 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:37.307756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f1b94-def7-4b93-b009-d91e74c2186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:37.308585 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f1b94-def7-4b93-b009-d91e74c2186e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.308864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f1b94-def7-4b93-b009-d91e74c2186e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.309143 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f1b94-def7-4b93-b009-d91e74c2186e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.310839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89d422-bd1d-4310-af2e-be8163b29d42 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:37.318189 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908413c5-b5ac-4f49-97ed-7c81d6fb6a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:37.319414 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908413c5-b5ac-4f49-97ed-7c81d6fb6a49 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.319870 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908413c5-b5ac-4f49-97ed-7c81d6fb6a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.320433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908413c5-b5ac-4f49-97ed-7c81d6fb6a49 admin admin] PATH_INFO: `/v3/groups/842f42d3b1084b529b150d8bf78c00d7` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.321903 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908413c5-b5ac-4f49-97ed-7c81d6fb6a49 admin admin] RBAC: Authorizing `identity:get_group(group_id=842f42d3b1084b529b150d8bf78c00d7)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:37.324229 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908413c5-b5ac-4f49-97ed-7c81d6fb6a49 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:37.326547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 204/393] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:37 2021] GET /identity/v3/groups/842f42d3b1084b529b150d8bf78c00d7 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:37.331245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f1b94-def7-4b93-b009-d91e74c2186e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:37.332628 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908413c5-b5ac-4f49-97ed-7c81d6fb6a49 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:37.337702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-ca8f1b94-def7-4b93-b009-d91e74c2186e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:37.339538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 190/394] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:37.345291 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f1b94-def7-4b93-b009-d91e74c2186e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:37.347969 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908413c5-b5ac-4f49-97ed-7c81d6fb6a49 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:37.356108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42313a7-f31e-4696-a144-f3e2d6cdbd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:37.356873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f1b94-def7-4b93-b009-d91e74c2186e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:37.357064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42313a7-f31e-4696-a144-f3e2d6cdbd25 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.357225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42313a7-f31e-4696-a144-f3e2d6cdbd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.357574 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42313a7-f31e-4696-a144-f3e2d6cdbd25 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.358980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42313a7-f31e-4696-a144-f3e2d6cdbd25 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:37.362049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42313a7-f31e-4696-a144-f3e2d6cdbd25 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:37.362531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bfd4b-f1b2-4f43-b2ba-4888b8caaac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:37.363088 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bfd4b-f1b2-4f43-b2ba-4888b8caaac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.363366 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bfd4b-f1b2-4f43-b2ba-4888b8caaac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.363648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bfd4b-f1b2-4f43-b2ba-4888b8caaac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.364508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bfd4b-f1b2-4f43-b2ba-4888b8caaac8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:37.364815 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bfd4b-f1b2-4f43-b2ba-4888b8caaac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:37.366688 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bfd4b-f1b2-4f43-b2ba-4888b8caaac8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:37.368436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 205/395] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:37 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:37.370907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42313a7-f31e-4696-a144-f3e2d6cdbd25 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:37.377327 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 191/396] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:37.383613 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bfd4b-f1b2-4f43-b2ba-4888b8caaac8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:37.384170 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42313a7-f31e-4696-a144-f3e2d6cdbd25 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:37.390634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184131dd-c94c-4eda-b216-3bab7ecf7d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:37.391788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184131dd-c94c-4eda-b216-3bab7ecf7d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.392090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184131dd-c94c-4eda-b216-3bab7ecf7d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.392888 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184131dd-c94c-4eda-b216-3bab7ecf7d7f admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b/groups/842f42d3b1084b529b150d8bf78c00d7/roles/1dbfc98083ce41ea943fbb3de6be133e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.394478 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bfd4b-f1b2-4f43-b2ba-4888b8caaac8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:37.395252 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184131dd-c94c-4eda-b216-3bab7ecf7d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbc52dd5f424931a362b9a5e7697c8b, group_id=842f42d3b1084b529b150d8bf78c00d7, role_id=1dbfc98083ce41ea943fbb3de6be133e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:37.400863 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184131dd-c94c-4eda-b216-3bab7ecf7d7f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:37.401564 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198d5be-e487-42b1-8f24-d95dfe40eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:37.402504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198d5be-e487-42b1-8f24-d95dfe40eb88 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.402828 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198d5be-e487-42b1-8f24-d95dfe40eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.403113 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198d5be-e487-42b1-8f24-d95dfe40eb88 admin admin] PATH_INFO: `/v3/groups/842f42d3b1084b529b150d8bf78c00d7` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.405233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198d5be-e487-42b1-8f24-d95dfe40eb88 admin admin] RBAC: Authorizing `identity:get_group(group_id=842f42d3b1084b529b150d8bf78c00d7)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:37.407520 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198d5be-e487-42b1-8f24-d95dfe40eb88 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:37.412839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 192/397] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:37 2021] GET /identity/v3/groups/842f42d3b1084b529b150d8bf78c00d7 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:37.418998 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198d5be-e487-42b1-8f24-d95dfe40eb88 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:37.424474 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 206/398] 10.222.0.23 () {58 vars in 1463 bytes} [Thu Dec 9 00:56:37 2021] PUT /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b/groups/842f42d3b1084b529b150d8bf78c00d7/roles/1dbfc98083ce41ea943fbb3de6be133e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 00:56:37.431253 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198d5be-e487-42b1-8f24-d95dfe40eb88 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:37.499137 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f7ac0-0f08-47ea-9e39-39ca95439233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:37.499894 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7ac0-0f08-47ea-9e39-39ca95439233 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.500170 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7ac0-0f08-47ea-9e39-39ca95439233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.500440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7ac0-0f08-47ea-9e39-39ca95439233 admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.501741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f7ac0-0f08-47ea-9e39-39ca95439233 admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:37.504226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f7ac0-0f08-47ea-9e39-39ca95439233 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:37.506407 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 193/399] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:37 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:37.512317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184131dd-c94c-4eda-b216-3bab7ecf7d7f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:37.532004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184131dd-c94c-4eda-b216-3bab7ecf7d7f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:37.538593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae00c3b-b9e0-4b7a-88cf-56bc536bf60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:37.539901 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae00c3b-b9e0-4b7a-88cf-56bc536bf60a admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:37.540379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae00c3b-b9e0-4b7a-88cf-56bc536bf60a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:37.540843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae00c3b-b9e0-4b7a-88cf-56bc536bf60a admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff/groups/842f42d3b1084b529b150d8bf78c00d7/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:37.543353 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae00c3b-b9e0-4b7a-88cf-56bc536bf60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97292c93fce46b1bf851f877c9530ff, group_id=842f42d3b1084b529b150d8bf78c00d7, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:37.546312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae00c3b-b9e0-4b7a-88cf-56bc536bf60a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:37.573840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 207/400] 10.222.0.23 () {58 vars in 1463 bytes} [Thu Dec 9 00:56:37 2021] PUT /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff/groups/842f42d3b1084b529b150d8bf78c00d7/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:38.291944 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46726-4475-4645-be1c-2593c2361115 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:38.292419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46726-4475-4645-be1c-2593c2361115 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:38.292544 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46726-4475-4645-be1c-2593c2361115 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:38.294633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 194/401] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:38.301895 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dd244-ad92-498d-98ab-5dc7db6cf7f2 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:38.302570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dd244-ad92-498d-98ab-5dc7db6cf7f2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:38.303045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dd244-ad92-498d-98ab-5dc7db6cf7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:38.331412 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-6b2dd244-ad92-498d-98ab-5dc7db6cf7f2 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:38.332994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6b2dd244-ad92-498d-98ab-5dc7db6cf7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:38.400624 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 208/402] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:38.435866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb46726-4475-4645-be1c-2593c2361115 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:38.455088 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb46726-4475-4645-be1c-2593c2361115 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:38.460208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76b74-6833-47ec-830b-700de0f55626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:38.461418 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76b74-6833-47ec-830b-700de0f55626 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:38.461897 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76b74-6833-47ec-830b-700de0f55626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:38.462397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76b74-6833-47ec-830b-700de0f55626 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:38.483757 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac76b74-6833-47ec-830b-700de0f55626 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:38.491673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-7ac76b74-6833-47ec-830b-700de0f55626 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:38.493203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 195/403] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:38.499465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dd244-ad92-498d-98ab-5dc7db6cf7f2 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:38.515356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dd244-ad92-498d-98ab-5dc7db6cf7f2 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:38.521072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b4c99-2ae8-4ec2-9179-9806c096a659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:38.521976 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4c99-2ae8-4ec2-9179-9806c096a659 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:38.522477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4c99-2ae8-4ec2-9179-9806c096a659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:38.522954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4c99-2ae8-4ec2-9179-9806c096a659 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:38.523899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b4c99-2ae8-4ec2-9179-9806c096a659 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:38.524406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b4c99-2ae8-4ec2-9179-9806c096a659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:38.526210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b4c99-2ae8-4ec2-9179-9806c096a659 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:38.538412 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 209/404] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:38.544669 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76b74-6833-47ec-830b-700de0f55626 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:38.555210 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76b74-6833-47ec-830b-700de0f55626 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:38.566699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2245773-b53a-46ec-a0e6-71f0a5ec4708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:38.567851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245773-b53a-46ec-a0e6-71f0a5ec4708 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:38.568325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245773-b53a-46ec-a0e6-71f0a5ec4708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:38.568797 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245773-b53a-46ec-a0e6-71f0a5ec4708 admin admin] PATH_INFO: `/v3/groups/842f42d3b1084b529b150d8bf78c00d7` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:38.570196 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2245773-b53a-46ec-a0e6-71f0a5ec4708 admin admin] RBAC: Authorizing `identity:get_group(group_id=842f42d3b1084b529b150d8bf78c00d7)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:38.572311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2245773-b53a-46ec-a0e6-71f0a5ec4708 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:38.574133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 196/405] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:38 2021] GET /identity/v3/groups/842f42d3b1084b529b150d8bf78c00d7 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:38.580271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b4c99-2ae8-4ec2-9179-9806c096a659 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:38.590246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b4c99-2ae8-4ec2-9179-9806c096a659 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:38.595037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d190a-84ec-4d05-b6e5-2d9cbb2b22bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:38.596822 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d190a-84ec-4d05-b6e5-2d9cbb2b22bb admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:38.597301 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d190a-84ec-4d05-b6e5-2d9cbb2b22bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:38.597742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d190a-84ec-4d05-b6e5-2d9cbb2b22bb admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:38.599131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d190a-84ec-4d05-b6e5-2d9cbb2b22bb admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:38.601325 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d190a-84ec-4d05-b6e5-2d9cbb2b22bb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:38.603174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 210/406] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:38 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:38.610177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2245773-b53a-46ec-a0e6-71f0a5ec4708 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:38.621983 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2245773-b53a-46ec-a0e6-71f0a5ec4708 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:38.627272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85de0b-75c0-4d40-9912-5b6b4d8af3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:38.628343 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85de0b-75c0-4d40-9912-5b6b4d8af3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:38.628795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85de0b-75c0-4d40-9912-5b6b4d8af3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:38.629255 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85de0b-75c0-4d40-9912-5b6b4d8af3aa admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff/groups/842f42d3b1084b529b150d8bf78c00d7/roles/1dbfc98083ce41ea943fbb3de6be133e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:38.633887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85de0b-75c0-4d40-9912-5b6b4d8af3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97292c93fce46b1bf851f877c9530ff, group_id=842f42d3b1084b529b150d8bf78c00d7, role_id=1dbfc98083ce41ea943fbb3de6be133e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:38.636742 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85de0b-75c0-4d40-9912-5b6b4d8af3aa admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:38.654030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 197/407] 10.222.0.23 () {58 vars in 1463 bytes} [Thu Dec 9 00:56:38 2021] PUT /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff/groups/842f42d3b1084b529b150d8bf78c00d7/roles/1dbfc98083ce41ea943fbb3de6be133e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:38.735635 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f80944-f212-4003-9f8e-e5d144faf592 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:38.736583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f80944-f212-4003-9f8e-e5d144faf592 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:38.737081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f80944-f212-4003-9f8e-e5d144faf592 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:38.739845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 211/408] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:38.746606 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1ed79-2d3f-4cc6-a428-70fa141d89bb None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:38.746895 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1ed79-2d3f-4cc6-a428-70fa141d89bb None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:38.747175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1ed79-2d3f-4cc6-a428-70fa141d89bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:38.770643 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d9b1ed79-2d3f-4cc6-a428-70fa141d89bb None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:38.771893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d9b1ed79-2d3f-4cc6-a428-70fa141d89bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:38.839252 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 198/409] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:38.879615 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f80944-f212-4003-9f8e-e5d144faf592 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:38.899614 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f80944-f212-4003-9f8e-e5d144faf592 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:38.905963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2dd0a-6644-478a-8b93-0bd28877a612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:38.906783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2dd0a-6644-478a-8b93-0bd28877a612 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:38.907059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2dd0a-6644-478a-8b93-0bd28877a612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:38.907330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2dd0a-6644-478a-8b93-0bd28877a612 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:38.923054 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2dd0a-6644-478a-8b93-0bd28877a612 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:38.930643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-45f2dd0a-6644-478a-8b93-0bd28877a612 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:56:38.933223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 212/410] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:56:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:38.938525 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1ed79-2d3f-4cc6-a428-70fa141d89bb None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:38.948566 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1ed79-2d3f-4cc6-a428-70fa141d89bb None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:38.965706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dc239-4252-4256-8d8e-e3d57bbf7d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:38.966425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dc239-4252-4256-8d8e-e3d57bbf7d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:38.966716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dc239-4252-4256-8d8e-e3d57bbf7d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:38.966998 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dc239-4252-4256-8d8e-e3d57bbf7d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:38.967787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dc239-4252-4256-8d8e-e3d57bbf7d93 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:38.968098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dc239-4252-4256-8d8e-e3d57bbf7d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:38.969721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dc239-4252-4256-8d8e-e3d57bbf7d93 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:38.985185 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 199/411] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:38.991923 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2dd0a-6644-478a-8b93-0bd28877a612 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:39.007931 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2dd0a-6644-478a-8b93-0bd28877a612 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:39.014302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc790d-f6b2-4c8e-9b33-ee6914df9452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:39.015256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc790d-f6b2-4c8e-9b33-ee6914df9452 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:39.015545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc790d-f6b2-4c8e-9b33-ee6914df9452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:39.015819 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc790d-f6b2-4c8e-9b33-ee6914df9452 admin admin] PATH_INFO: `/v3/groups/52d1434da35a4c57860f46bfb9132d46` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:39.017036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc790d-f6b2-4c8e-9b33-ee6914df9452 admin admin] RBAC: Authorizing `identity:get_group(group_id=52d1434da35a4c57860f46bfb9132d46)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:39.019852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc790d-f6b2-4c8e-9b33-ee6914df9452 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:39.021674 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 213/412] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:38 2021] GET /identity/v3/groups/52d1434da35a4c57860f46bfb9132d46 => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:39.027813 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dc239-4252-4256-8d8e-e3d57bbf7d93 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:39.037921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dc239-4252-4256-8d8e-e3d57bbf7d93 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:39.043502 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c29d0-ddf4-4dc6-9d58-cbb8bb728e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:39.044361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c29d0-ddf4-4dc6-9d58-cbb8bb728e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:39.044642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c29d0-ddf4-4dc6-9d58-cbb8bb728e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:39.044936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c29d0-ddf4-4dc6-9d58-cbb8bb728e93 admin admin] PATH_INFO: `/v3/projects/190e540339684142b1a25d3f47e2a0ee` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:39.047302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c29d0-ddf4-4dc6-9d58-cbb8bb728e93 admin admin] RBAC: Authorizing `identity:get_project(project_id=190e540339684142b1a25d3f47e2a0ee)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:39.050133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c29d0-ddf4-4dc6-9d58-cbb8bb728e93 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:39.052064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 200/413] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:39 2021] GET /identity/v3/projects/190e540339684142b1a25d3f47e2a0ee => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:39.058995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc790d-f6b2-4c8e-9b33-ee6914df9452 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:39.069620 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc790d-f6b2-4c8e-9b33-ee6914df9452 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:39.075404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc1585-a1e2-4b59-8e20-d3d4f863b10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:39.076428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1585-a1e2-4b59-8e20-d3d4f863b10d admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:39.076711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1585-a1e2-4b59-8e20-d3d4f863b10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:39.076991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1585-a1e2-4b59-8e20-d3d4f863b10d admin admin] PATH_INFO: `/v3/projects/190e540339684142b1a25d3f47e2a0ee/groups/52d1434da35a4c57860f46bfb9132d46/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:39.079123 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc1585-a1e2-4b59-8e20-d3d4f863b10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=190e540339684142b1a25d3f47e2a0ee, group_id=52d1434da35a4c57860f46bfb9132d46, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:39.082722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc1585-a1e2-4b59-8e20-d3d4f863b10d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:39.106003 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 214/414] 10.222.0.23 () {58 vars in 1463 bytes} [Thu Dec 9 00:56:39 2021] PUT /identity/v3/projects/190e540339684142b1a25d3f47e2a0ee/groups/52d1434da35a4c57860f46bfb9132d46/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:40.171434 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab64248-a575-4b72-a382-4a476de6ccdc None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.172082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab64248-a575-4b72-a382-4a476de6ccdc None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.172082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab64248-a575-4b72-a382-4a476de6ccdc None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.173849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 201/415] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:40.180172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea65d9a-4ddb-4ff1-8b88-b5c49bcbfcf7 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.180704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea65d9a-4ddb-4ff1-8b88-b5c49bcbfcf7 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.180704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea65d9a-4ddb-4ff1-8b88-b5c49bcbfcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.203061 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-1ea65d9a-4ddb-4ff1-8b88-b5c49bcbfcf7 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:40.204260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1ea65d9a-4ddb-4ff1-8b88-b5c49bcbfcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:40.277433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 215/416] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:40.315754 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab64248-a575-4b72-a382-4a476de6ccdc None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:40.331139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab64248-a575-4b72-a382-4a476de6ccdc None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:40.335635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ce0c2-8149-40e3-8fc0-fed5035cc286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:40.336425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ce0c2-8149-40e3-8fc0-fed5035cc286 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.336702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ce0c2-8149-40e3-8fc0-fed5035cc286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.336974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ce0c2-8149-40e3-8fc0-fed5035cc286 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.348792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ce0c2-8149-40e3-8fc0-fed5035cc286 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:40.355732 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-3a9ce0c2-8149-40e3-8fc0-fed5035cc286 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:40.357329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 202/417] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:40.364208 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea65d9a-4ddb-4ff1-8b88-b5c49bcbfcf7 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:40.373312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea65d9a-4ddb-4ff1-8b88-b5c49bcbfcf7 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:40.382718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed80e74-74b5-4232-a450-69776db7a421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:40.383398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80e74-74b5-4232-a450-69776db7a421 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.383684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80e74-74b5-4232-a450-69776db7a421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.383956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80e74-74b5-4232-a450-69776db7a421 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.384726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed80e74-74b5-4232-a450-69776db7a421 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:40.385028 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed80e74-74b5-4232-a450-69776db7a421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:40.386662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed80e74-74b5-4232-a450-69776db7a421 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:40.398590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 216/418] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:40.404708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ce0c2-8149-40e3-8fc0-fed5035cc286 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:40.416205 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ce0c2-8149-40e3-8fc0-fed5035cc286 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:40.423027 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958b241-9b29-449a-bdc2-b8f77020a78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:40.424150 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958b241-9b29-449a-bdc2-b8f77020a78a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.424497 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958b241-9b29-449a-bdc2-b8f77020a78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.424670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958b241-9b29-449a-bdc2-b8f77020a78a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.433121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958b241-9b29-449a-bdc2-b8f77020a78a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:40.434902 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958b241-9b29-449a-bdc2-b8f77020a78a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:40.445427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 203/419] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:40.451845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed80e74-74b5-4232-a450-69776db7a421 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:40.467592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed80e74-74b5-4232-a450-69776db7a421 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:40.472569 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f495-a564-4166-9c2f-84f8dc9112a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:40.473424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f495-a564-4166-9c2f-84f8dc9112a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.473708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f495-a564-4166-9c2f-84f8dc9112a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.473983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f495-a564-4166-9c2f-84f8dc9112a3 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.475611 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003f495-a564-4166-9c2f-84f8dc9112a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:40.477656 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003f495-a564-4166-9c2f-84f8dc9112a3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:40.479647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 217/420] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:40 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:40.485477 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958b241-9b29-449a-bdc2-b8f77020a78a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:40.495676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958b241-9b29-449a-bdc2-b8f77020a78a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:40.500442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1459b50-db3d-40d1-a09c-5e37b16ad2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:40.501613 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1459b50-db3d-40d1-a09c-5e37b16ad2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.502108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1459b50-db3d-40d1-a09c-5e37b16ad2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.502647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1459b50-db3d-40d1-a09c-5e37b16ad2d2 admin admin] PATH_INFO: `/v3/groups/842f42d3b1084b529b150d8bf78c00d7` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.504016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1459b50-db3d-40d1-a09c-5e37b16ad2d2 admin admin] RBAC: Authorizing `identity:get_group(group_id=842f42d3b1084b529b150d8bf78c00d7)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:40.506739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1459b50-db3d-40d1-a09c-5e37b16ad2d2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:40.508616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 204/421] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:40 2021] GET /identity/v3/groups/842f42d3b1084b529b150d8bf78c00d7 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:40.515037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f495-a564-4166-9c2f-84f8dc9112a3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:40.525629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f495-a564-4166-9c2f-84f8dc9112a3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:40.534843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6201f-a516-47c0-b611-7c05e8510df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:40.535560 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6201f-a516-47c0-b611-7c05e8510df3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.535846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6201f-a516-47c0-b611-7c05e8510df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.536127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6201f-a516-47c0-b611-7c05e8510df3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.536978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6201f-a516-47c0-b611-7c05e8510df3 admin admin] RBAC: Adding query filter params (group.id=842f42d3b1084b529b150d8bf78c00d7, role.id=800b8a36452a418b82e9e25cef933520, scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:40.537290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6201f-a516-47c0-b611-7c05e8510df3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:40.539317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6201f-a516-47c0-b611-7c05e8510df3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:40.554882 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 218/422] 10.222.0.23 () {56 vars in 1397 bytes} [Thu Dec 9 00:56:40 2021] GET /identity/v3/role_assignments?group.id=842f42d3b1084b529b150d8bf78c00d7&scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b&role.id=800b8a36452a418b82e9e25cef933520 => generated 611 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:40.766724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8f9e-b50a-4e8b-86fc-42740395e155 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.767064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8f9e-b50a-4e8b-86fc-42740395e155 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.767297 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8f9e-b50a-4e8b-86fc-42740395e155 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.769441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 205/423] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:40.775840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0ff08-2d6b-4805-a8e4-3fb70403aaa4 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.776138 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0ff08-2d6b-4805-a8e4-3fb70403aaa4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.776421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0ff08-2d6b-4805-a8e4-3fb70403aaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.800248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-0ea0ff08-2d6b-4805-a8e4-3fb70403aaa4 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:40.801546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0ea0ff08-2d6b-4805-a8e4-3fb70403aaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:40.811408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 219/424] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:40.839625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b8f9e-b50a-4e8b-86fc-42740395e155 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:40.872568 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b8f9e-b50a-4e8b-86fc-42740395e155 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:40.879858 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0ac6-a785-4ca6-ace4-9c2d98c5c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:40.880825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0ac6-a785-4ca6-ace4-9c2d98c5c3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.881281 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0ac6-a785-4ca6-ace4-9c2d98c5c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.881699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0ac6-a785-4ca6-ace4-9c2d98c5c3d3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.894645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd0ac6-a785-4ca6-ace4-9c2d98c5c3d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:40.903820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-16cd0ac6-a785-4ca6-ace4-9c2d98c5c3d3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:40.905533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 206/425] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:40.912770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0ff08-2d6b-4805-a8e4-3fb70403aaa4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:40.926645 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0ff08-2d6b-4805-a8e4-3fb70403aaa4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:40.932376 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0ea30-ca99-4955-8961-9e190769718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:40.933203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0ea30-ca99-4955-8961-9e190769718c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.933632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0ea30-ca99-4955-8961-9e190769718c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.934125 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0ea30-ca99-4955-8961-9e190769718c admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.935092 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0ea30-ca99-4955-8961-9e190769718c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:40.935564 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0ea30-ca99-4955-8961-9e190769718c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:40.937295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0ea30-ca99-4955-8961-9e190769718c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:40.948004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 220/426] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:40.954270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0ac6-a785-4ca6-ace4-9c2d98c5c3d3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:40.964963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0ac6-a785-4ca6-ace4-9c2d98c5c3d3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:40.973145 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79054f0-d5f5-46c3-b90f-bfbe21a370ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:40.974035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79054f0-d5f5-46c3-b90f-bfbe21a370ec admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:40.974534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79054f0-d5f5-46c3-b90f-bfbe21a370ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:40.974984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79054f0-d5f5-46c3-b90f-bfbe21a370ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:40.986457 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79054f0-d5f5-46c3-b90f-bfbe21a370ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:40.988896 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79054f0-d5f5-46c3-b90f-bfbe21a370ec admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:41.003782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 207/427] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:41.010216 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0ea30-ca99-4955-8961-9e190769718c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:41.021259 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0ea30-ca99-4955-8961-9e190769718c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:41.028622 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229e2f7-ded6-44fc-bb05-926197cd73b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:41.029711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229e2f7-ded6-44fc-bb05-926197cd73b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.030192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229e2f7-ded6-44fc-bb05-926197cd73b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.030638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229e2f7-ded6-44fc-bb05-926197cd73b3 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.032120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229e2f7-ded6-44fc-bb05-926197cd73b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:41.035430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229e2f7-ded6-44fc-bb05-926197cd73b3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:41.037785 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 221/428] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:41.044045 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79054f0-d5f5-46c3-b90f-bfbe21a370ec admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:41.054062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79054f0-d5f5-46c3-b90f-bfbe21a370ec admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:41.060496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c9598-326c-409f-983c-fa489198060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:41.061594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c9598-326c-409f-983c-fa489198060c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.062022 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c9598-326c-409f-983c-fa489198060c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.062477 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c9598-326c-409f-983c-fa489198060c admin admin] PATH_INFO: `/v3/groups/842f42d3b1084b529b150d8bf78c00d7` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.063891 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c9598-326c-409f-983c-fa489198060c admin admin] RBAC: Authorizing `identity:get_group(group_id=842f42d3b1084b529b150d8bf78c00d7)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:41.066107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c9598-326c-409f-983c-fa489198060c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:41.067946 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 208/429] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/groups/842f42d3b1084b529b150d8bf78c00d7 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:41.075024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229e2f7-ded6-44fc-bb05-926197cd73b3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:41.086163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229e2f7-ded6-44fc-bb05-926197cd73b3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:41.091192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa588d-ba5a-4211-870e-a7b4e71b7fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:41.092091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa588d-ba5a-4211-870e-a7b4e71b7fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.092522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa588d-ba5a-4211-870e-a7b4e71b7fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.092940 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa588d-ba5a-4211-870e-a7b4e71b7fb9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.094067 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa588d-ba5a-4211-870e-a7b4e71b7fb9 admin admin] RBAC: Adding query filter params (group.id=842f42d3b1084b529b150d8bf78c00d7, role.id=1dbfc98083ce41ea943fbb3de6be133e, scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:41.094567 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa588d-ba5a-4211-870e-a7b4e71b7fb9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:41.097248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa588d-ba5a-4211-870e-a7b4e71b7fb9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:41.104425 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 222/430] 10.222.0.23 () {56 vars in 1397 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/role_assignments?group.id=842f42d3b1084b529b150d8bf78c00d7&scope.project.id=3dbc52dd5f424931a362b9a5e7697c8b&role.id=1dbfc98083ce41ea943fbb3de6be133e => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:41.131925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40fc2e-cc58-4028-b09f-bfd7d7590bb0 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.132447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40fc2e-cc58-4028-b09f-bfd7d7590bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.132873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40fc2e-cc58-4028-b09f-bfd7d7590bb0 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.135216 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 209/431] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:41.150050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816b6a-7f3e-487a-a340-e57332cbd630 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.150386 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816b6a-7f3e-487a-a340-e57332cbd630 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.150649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816b6a-7f3e-487a-a340-e57332cbd630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.178979 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-24816b6a-7f3e-487a-a340-e57332cbd630 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:41.180230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-24816b6a-7f3e-487a-a340-e57332cbd630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:41.189670 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 223/432] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:41.216621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40fc2e-cc58-4028-b09f-bfd7d7590bb0 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:41.233178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40fc2e-cc58-4028-b09f-bfd7d7590bb0 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:41.243958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ccb7c-e729-421c-9589-ab8b8b5e7c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:41.244774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ccb7c-e729-421c-9589-ab8b8b5e7c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.245052 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ccb7c-e729-421c-9589-ab8b8b5e7c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.245319 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ccb7c-e729-421c-9589-ab8b8b5e7c54 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.261484 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ccb7c-e729-421c-9589-ab8b8b5e7c54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:41.269153 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-329ccb7c-e729-421c-9589-ab8b8b5e7c54 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 09 00:56:41.270749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 210/433] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:41.277052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816b6a-7f3e-487a-a340-e57332cbd630 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:41.286763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816b6a-7f3e-487a-a340-e57332cbd630 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:41.296568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89ffa5-ae46-42bc-8c93-1bcb835a9ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:41.297263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89ffa5-ae46-42bc-8c93-1bcb835a9ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.297546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89ffa5-ae46-42bc-8c93-1bcb835a9ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.297824 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89ffa5-ae46-42bc-8c93-1bcb835a9ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.299142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89ffa5-ae46-42bc-8c93-1bcb835a9ce5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:41.299455 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89ffa5-ae46-42bc-8c93-1bcb835a9ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:41.301085 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89ffa5-ae46-42bc-8c93-1bcb835a9ce5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:41.313374 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 224/434] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:41.319293 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ccb7c-e729-421c-9589-ab8b8b5e7c54 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:41.332749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ccb7c-e729-421c-9589-ab8b8b5e7c54 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:41.340313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e7b39-21b7-4f25-bad6-8c0e2f889bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:41.340970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e7b39-21b7-4f25-bad6-8c0e2f889bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.341254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e7b39-21b7-4f25-bad6-8c0e2f889bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.341530 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e7b39-21b7-4f25-bad6-8c0e2f889bd0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.354037 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e7b39-21b7-4f25-bad6-8c0e2f889bd0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:41.355897 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e7b39-21b7-4f25-bad6-8c0e2f889bd0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:41.368438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 211/435] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:41.374848 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89ffa5-ae46-42bc-8c93-1bcb835a9ce5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:41.388237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89ffa5-ae46-42bc-8c93-1bcb835a9ce5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:41.394776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d3852-4ff5-45f1-a898-e308d7dfd1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:41.395757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d3852-4ff5-45f1-a898-e308d7dfd1ca admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.396113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d3852-4ff5-45f1-a898-e308d7dfd1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.396463 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d3852-4ff5-45f1-a898-e308d7dfd1ca admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.397824 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d3852-4ff5-45f1-a898-e308d7dfd1ca admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:41.400141 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d3852-4ff5-45f1-a898-e308d7dfd1ca admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:41.402470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 225/436] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:41.409571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e7b39-21b7-4f25-bad6-8c0e2f889bd0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:41.419306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e7b39-21b7-4f25-bad6-8c0e2f889bd0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:41.427523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be1d89-56fb-4b51-827d-3c13776394e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:41.428556 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be1d89-56fb-4b51-827d-3c13776394e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.428975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be1d89-56fb-4b51-827d-3c13776394e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.429408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be1d89-56fb-4b51-827d-3c13776394e9 admin admin] PATH_INFO: `/v3/groups/842f42d3b1084b529b150d8bf78c00d7` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.431726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be1d89-56fb-4b51-827d-3c13776394e9 admin admin] RBAC: Authorizing `identity:get_group(group_id=842f42d3b1084b529b150d8bf78c00d7)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:41.433750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be1d89-56fb-4b51-827d-3c13776394e9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:41.435515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 212/437] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/groups/842f42d3b1084b529b150d8bf78c00d7 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:41.442793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d3852-4ff5-45f1-a898-e308d7dfd1ca admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:41.453509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d3852-4ff5-45f1-a898-e308d7dfd1ca admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:41.459234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ee94e-af67-4ff8-9fd1-a0a6640c828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:41.459880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ee94e-af67-4ff8-9fd1-a0a6640c828b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.460160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ee94e-af67-4ff8-9fd1-a0a6640c828b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.460435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ee94e-af67-4ff8-9fd1-a0a6640c828b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.461272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ee94e-af67-4ff8-9fd1-a0a6640c828b admin admin] RBAC: Adding query filter params (group.id=842f42d3b1084b529b150d8bf78c00d7, role.id=800b8a36452a418b82e9e25cef933520, scope.project.id=c97292c93fce46b1bf851f877c9530ff) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:41.461581 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ee94e-af67-4ff8-9fd1-a0a6640c828b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:41.463521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ee94e-af67-4ff8-9fd1-a0a6640c828b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:41.471866 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 226/438] 10.222.0.23 () {56 vars in 1397 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/role_assignments?group.id=842f42d3b1084b529b150d8bf78c00d7&scope.project.id=c97292c93fce46b1bf851f877c9530ff&role.id=800b8a36452a418b82e9e25cef933520 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:41.802492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7df6-bc74-4a4e-addd-b58dad28c6a1 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.802777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7df6-bc74-4a4e-addd-b58dad28c6a1 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.803054 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7df6-bc74-4a4e-addd-b58dad28c6a1 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.804955 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 213/439] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:41.810951 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457c389-477b-4111-bc53-e788d5305a42 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.811237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457c389-477b-4111-bc53-e788d5305a42 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.811517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457c389-477b-4111-bc53-e788d5305a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.829246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-4457c389-477b-4111-bc53-e788d5305a42 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:41.831276 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-4457c389-477b-4111-bc53-e788d5305a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:41.838813 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 227/440] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:41.863633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7df6-bc74-4a4e-addd-b58dad28c6a1 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:41.877442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7df6-bc74-4a4e-addd-b58dad28c6a1 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:41.881716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b906cf-10d8-4d45-ba67-b4bd0b773e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:41.882537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b906cf-10d8-4d45-ba67-b4bd0b773e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.882821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b906cf-10d8-4d45-ba67-b4bd0b773e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.883090 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b906cf-10d8-4d45-ba67-b4bd0b773e88 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.896363 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b906cf-10d8-4d45-ba67-b4bd0b773e88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:41.903668 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-b1b906cf-10d8-4d45-ba67-b4bd0b773e88 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:41.905173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 214/441] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:41.911912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457c389-477b-4111-bc53-e788d5305a42 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:41.921288 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457c389-477b-4111-bc53-e788d5305a42 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:41.926172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45383407-8c66-4ade-b90f-5c10f4035e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:41.926931 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45383407-8c66-4ade-b90f-5c10f4035e25 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.927217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45383407-8c66-4ade-b90f-5c10f4035e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.927497 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45383407-8c66-4ade-b90f-5c10f4035e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.928259 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45383407-8c66-4ade-b90f-5c10f4035e25 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:41.928567 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45383407-8c66-4ade-b90f-5c10f4035e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:41.930175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45383407-8c66-4ade-b90f-5c10f4035e25 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:41.938857 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 228/442] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:41.945877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b906cf-10d8-4d45-ba67-b4bd0b773e88 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:41.956621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b906cf-10d8-4d45-ba67-b4bd0b773e88 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:41.961918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f33c3-a835-49a6-a6c8-10f27c10e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:41.962661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f33c3-a835-49a6-a6c8-10f27c10e24d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:41.962945 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f33c3-a835-49a6-a6c8-10f27c10e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:41.963357 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f33c3-a835-49a6-a6c8-10f27c10e24d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:41.974884 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f33c3-a835-49a6-a6c8-10f27c10e24d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:41.976645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f33c3-a835-49a6-a6c8-10f27c10e24d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:41.986617 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 215/443] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:41.993254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45383407-8c66-4ade-b90f-5c10f4035e25 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:42.005102 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45383407-8c66-4ade-b90f-5c10f4035e25 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:42.009550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134a1d8-d10e-41eb-84dc-bae9f7abe97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:42.010422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134a1d8-d10e-41eb-84dc-bae9f7abe97d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:42.010712 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134a1d8-d10e-41eb-84dc-bae9f7abe97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:42.010989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134a1d8-d10e-41eb-84dc-bae9f7abe97d admin admin] PATH_INFO: `/v3/projects/c97292c93fce46b1bf851f877c9530ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:42.012198 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134a1d8-d10e-41eb-84dc-bae9f7abe97d admin admin] RBAC: Authorizing `identity:get_project(project_id=c97292c93fce46b1bf851f877c9530ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:42.014259 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134a1d8-d10e-41eb-84dc-bae9f7abe97d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:42.015969 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 229/444] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:41 2021] GET /identity/v3/projects/c97292c93fce46b1bf851f877c9530ff => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:42.023091 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f33c3-a835-49a6-a6c8-10f27c10e24d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:42.032241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f33c3-a835-49a6-a6c8-10f27c10e24d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:42.037315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f6a19-723c-4b07-a681-c8f268854724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:42.038433 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f6a19-723c-4b07-a681-c8f268854724 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:42.038717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f6a19-723c-4b07-a681-c8f268854724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:42.038992 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f6a19-723c-4b07-a681-c8f268854724 admin admin] PATH_INFO: `/v3/groups/842f42d3b1084b529b150d8bf78c00d7` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:42.040255 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f6a19-723c-4b07-a681-c8f268854724 admin admin] RBAC: Authorizing `identity:get_group(group_id=842f42d3b1084b529b150d8bf78c00d7)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:42.042119 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f6a19-723c-4b07-a681-c8f268854724 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:42.043841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 216/445] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:42 2021] GET /identity/v3/groups/842f42d3b1084b529b150d8bf78c00d7 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:42.050921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134a1d8-d10e-41eb-84dc-bae9f7abe97d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:42.061308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134a1d8-d10e-41eb-84dc-bae9f7abe97d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:42.065929 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742111c9-578c-4421-9e57-0f945d71e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:42.066651 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742111c9-578c-4421-9e57-0f945d71e371 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:42.066937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742111c9-578c-4421-9e57-0f945d71e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:42.067215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742111c9-578c-4421-9e57-0f945d71e371 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:42.068104 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742111c9-578c-4421-9e57-0f945d71e371 admin admin] RBAC: Adding query filter params (group.id=842f42d3b1084b529b150d8bf78c00d7, role.id=1dbfc98083ce41ea943fbb3de6be133e, scope.project.id=c97292c93fce46b1bf851f877c9530ff) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:42.068425 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742111c9-578c-4421-9e57-0f945d71e371 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:42.070284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742111c9-578c-4421-9e57-0f945d71e371 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:42.076861 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 230/446] 10.222.0.23 () {56 vars in 1397 bytes} [Thu Dec 9 00:56:42 2021] GET /identity/v3/role_assignments?group.id=842f42d3b1084b529b150d8bf78c00d7&scope.project.id=c97292c93fce46b1bf851f877c9530ff&role.id=1dbfc98083ce41ea943fbb3de6be133e => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:42.109518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cbeec-5986-4dbd-8ac2-3456d3ebb4a1 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:42.109851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cbeec-5986-4dbd-8ac2-3456d3ebb4a1 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:42.110063 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cbeec-5986-4dbd-8ac2-3456d3ebb4a1 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:42.112967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 217/447] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:42.119195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3176b6-019d-4eba-8fc2-f3599be39e7c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:42.119489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3176b6-019d-4eba-8fc2-f3599be39e7c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:42.119756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3176b6-019d-4eba-8fc2-f3599be39e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:42.138841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9c3176b6-019d-4eba-8fc2-f3599be39e7c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:42.140298 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9c3176b6-019d-4eba-8fc2-f3599be39e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:42.150703 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 231/448] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:42.175203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cbeec-5986-4dbd-8ac2-3456d3ebb4a1 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:42.187458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cbeec-5986-4dbd-8ac2-3456d3ebb4a1 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:42.192703 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e3df-9ab6-4c32-9b90-b3f9ee5d4ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:42.193499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e3df-9ab6-4c32-9b90-b3f9ee5d4ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:42.193779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e3df-9ab6-4c32-9b90-b3f9ee5d4ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:42.194049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e3df-9ab6-4c32-9b90-b3f9ee5d4ec3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:42.206241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7e3df-9ab6-4c32-9b90-b3f9ee5d4ec3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:42.214485 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-ddc7e3df-9ab6-4c32-9b90-b3f9ee5d4ec3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:56:42.215756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 218/449] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:56:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:42.222478 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3176b6-019d-4eba-8fc2-f3599be39e7c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:42.231795 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3176b6-019d-4eba-8fc2-f3599be39e7c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:42.236430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9496cfd-7335-4379-a250-a4b4af25c38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:42.237464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9496cfd-7335-4379-a250-a4b4af25c38a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:42.237766 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9496cfd-7335-4379-a250-a4b4af25c38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:42.238028 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9496cfd-7335-4379-a250-a4b4af25c38a admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:42.238842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9496cfd-7335-4379-a250-a4b4af25c38a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:42.239154 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9496cfd-7335-4379-a250-a4b4af25c38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:42.240815 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9496cfd-7335-4379-a250-a4b4af25c38a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:42.249733 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 232/450] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:42.256867 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e3df-9ab6-4c32-9b90-b3f9ee5d4ec3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:42.266892 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e3df-9ab6-4c32-9b90-b3f9ee5d4ec3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:42.272053 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bbbdf-abc8-460f-bf36-7966800d3efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:42.272712 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bbbdf-abc8-460f-bf36-7966800d3efd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:42.272996 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bbbdf-abc8-460f-bf36-7966800d3efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:42.273272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bbbdf-abc8-460f-bf36-7966800d3efd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:42.282329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bbbdf-abc8-460f-bf36-7966800d3efd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:42.284448 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bbbdf-abc8-460f-bf36-7966800d3efd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:42.293637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 219/451] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:42.300350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9496cfd-7335-4379-a250-a4b4af25c38a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:42.310115 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9496cfd-7335-4379-a250-a4b4af25c38a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:42.315691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62ccc1-8134-4145-8440-e2d2db8d9769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:42.316487 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62ccc1-8134-4145-8440-e2d2db8d9769 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:42.316762 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62ccc1-8134-4145-8440-e2d2db8d9769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:42.317032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62ccc1-8134-4145-8440-e2d2db8d9769 admin admin] PATH_INFO: `/v3/projects/190e540339684142b1a25d3f47e2a0ee` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:42.318234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62ccc1-8134-4145-8440-e2d2db8d9769 admin admin] RBAC: Authorizing `identity:get_project(project_id=190e540339684142b1a25d3f47e2a0ee)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:42.320073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62ccc1-8134-4145-8440-e2d2db8d9769 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:42.321718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 233/452] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:56:42 2021] GET /identity/v3/projects/190e540339684142b1a25d3f47e2a0ee => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:42.327746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bbbdf-abc8-460f-bf36-7966800d3efd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:42.337223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bbbdf-abc8-460f-bf36-7966800d3efd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:42.341579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b0b93-0822-4afd-89aa-68935c1659e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:42.342429 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b0b93-0822-4afd-89aa-68935c1659e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:42.342714 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b0b93-0822-4afd-89aa-68935c1659e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:42.342980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b0b93-0822-4afd-89aa-68935c1659e5 admin admin] PATH_INFO: `/v3/groups/52d1434da35a4c57860f46bfb9132d46` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:42.344142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b0b93-0822-4afd-89aa-68935c1659e5 admin admin] RBAC: Authorizing `identity:get_group(group_id=52d1434da35a4c57860f46bfb9132d46)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:42.346177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b0b93-0822-4afd-89aa-68935c1659e5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:42.347792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 220/453] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Dec 9 00:56:42 2021] GET /identity/v3/groups/52d1434da35a4c57860f46bfb9132d46 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:42.354063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62ccc1-8134-4145-8440-e2d2db8d9769 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:42.364099 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62ccc1-8134-4145-8440-e2d2db8d9769 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:42.368494 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65522ad9-1835-4782-a140-67070279955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:42.369190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65522ad9-1835-4782-a140-67070279955e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:42.369466 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65522ad9-1835-4782-a140-67070279955e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:42.369742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65522ad9-1835-4782-a140-67070279955e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:42.370634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65522ad9-1835-4782-a140-67070279955e admin admin] RBAC: Adding query filter params (group.id=52d1434da35a4c57860f46bfb9132d46, role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=190e540339684142b1a25d3f47e2a0ee) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:42.370944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65522ad9-1835-4782-a140-67070279955e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:42.372761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65522ad9-1835-4782-a140-67070279955e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:42.379758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 234/454] 10.222.0.23 () {56 vars in 1397 bytes} [Thu Dec 9 00:56:42 2021] GET /identity/v3/role_assignments?group.id=52d1434da35a4c57860f46bfb9132d46&scope.project.id=190e540339684142b1a25d3f47e2a0ee&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:45.344065 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44858b68-31ad-4ce6-bc97-a179dab59106 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.344579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44858b68-31ad-4ce6-bc97-a179dab59106 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.344655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44858b68-31ad-4ce6-bc97-a179dab59106 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.347148 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 221/455] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:45.353009 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a546-cfaa-4dc5-b56f-e16e029cc20b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.353418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a546-cfaa-4dc5-b56f-e16e029cc20b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.353586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a546-cfaa-4dc5-b56f-e16e029cc20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.379149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-94b1a546-cfaa-4dc5-b56f-e16e029cc20b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:45.380346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-94b1a546-cfaa-4dc5-b56f-e16e029cc20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:45.393935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 235/456] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:45.422622 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44858b68-31ad-4ce6-bc97-a179dab59106 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:45.446962 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44858b68-31ad-4ce6-bc97-a179dab59106 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:45.451411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5a2d3-37eb-4cbe-b1a4-4aa6e5355680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:45.452249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5a2d3-37eb-4cbe-b1a4-4aa6e5355680 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.452531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5a2d3-37eb-4cbe-b1a4-4aa6e5355680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.452804 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5a2d3-37eb-4cbe-b1a4-4aa6e5355680 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.466234 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5a2d3-37eb-4cbe-b1a4-4aa6e5355680 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:45.468071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5a2d3-37eb-4cbe-b1a4-4aa6e5355680 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:45.499490 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-1fc5a2d3-37eb-4cbe-b1a4-4aa6e5355680 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:45.500715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 222/457] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:45.507574 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a546-cfaa-4dc5-b56f-e16e029cc20b None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:45.524825 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a546-cfaa-4dc5-b56f-e16e029cc20b None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:45.536160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e9ea6-2cfd-410c-9135-39952c5acd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:45.536832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e9ea6-2cfd-410c-9135-39952c5acd50 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.537118 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e9ea6-2cfd-410c-9135-39952c5acd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.537391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e9ea6-2cfd-410c-9135-39952c5acd50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.538135 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e9ea6-2cfd-410c-9135-39952c5acd50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:45.538471 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e9ea6-2cfd-410c-9135-39952c5acd50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:45.540090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e9ea6-2cfd-410c-9135-39952c5acd50 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:45.559732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 236/458] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:45.565514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5a2d3-37eb-4cbe-b1a4-4aa6e5355680 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:45.580813 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5a2d3-37eb-4cbe-b1a4-4aa6e5355680 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:45.590477 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2576e0-4349-42d3-9e2c-56ca441b6927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:45.591362 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2576e0-4349-42d3-9e2c-56ca441b6927 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.591641 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2576e0-4349-42d3-9e2c-56ca441b6927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.591916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2576e0-4349-42d3-9e2c-56ca441b6927 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.592666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2576e0-4349-42d3-9e2c-56ca441b6927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:45.594860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2576e0-4349-42d3-9e2c-56ca441b6927 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:45.604142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4dc07-ebf4-4dbe-bc8c-0dea01074235 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.604473 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4dc07-ebf4-4dbe-bc8c-0dea01074235 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.604747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4dc07-ebf4-4dbe-bc8c-0dea01074235 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.606986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 237/459] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:45.614305 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3286be9-2d37-4c4e-b00a-d2cf01bfcc6b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.614635 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3286be9-2d37-4c4e-b00a-d2cf01bfcc6b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.614949 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3286be9-2d37-4c4e-b00a-d2cf01bfcc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.633164 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 223/460] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:56:45 2021] POST /identity/v3/users => generated 248 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 00:56:45.634603 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732eb4a-7a68-4d8f-bfca-cbfb23efe456 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.634886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732eb4a-7a68-4d8f-bfca-cbfb23efe456 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.635159 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732eb4a-7a68-4d8f-bfca-cbfb23efe456 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.637039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 224/461] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:45.642753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d3286be9-2d37-4c4e-b00a-d2cf01bfcc6b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:45.643463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706899f7-dd12-469b-a56d-116169a0904c None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.643749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706899f7-dd12-469b-a56d-116169a0904c None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.644026 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706899f7-dd12-469b-a56d-116169a0904c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.644187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d3286be9-2d37-4c4e-b00a-d2cf01bfcc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:45.661613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 238/462] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:45.677320 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-706899f7-dd12-469b-a56d-116169a0904c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:45.678642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-706899f7-dd12-469b-a56d-116169a0904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:45.688815 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 225/463] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:45.710424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3286be9-2d37-4c4e-b00a-d2cf01bfcc6b None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:45.720106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3286be9-2d37-4c4e-b00a-d2cf01bfcc6b None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:45.729083 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3eb2d-a7ab-495b-9055-e8f3afc0d5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:45.729894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3eb2d-a7ab-495b-9055-e8f3afc0d5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.730173 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3eb2d-a7ab-495b-9055-e8f3afc0d5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.730591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3eb2d-a7ab-495b-9055-e8f3afc0d5d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.738056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706899f7-dd12-469b-a56d-116169a0904c None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:45.748559 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706899f7-dd12-469b-a56d-116169a0904c None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:45.759853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3eb2d-a7ab-495b-9055-e8f3afc0d5d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:45.761727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3eb2d-a7ab-495b-9055-e8f3afc0d5d2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:45.763382 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e130c4c-ae2a-47b1-b4ff-8c92f61c00eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:45.764187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e130c4c-ae2a-47b1-b4ff-8c92f61c00eb admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.764468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e130c4c-ae2a-47b1-b4ff-8c92f61c00eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.764738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e130c4c-ae2a-47b1-b4ff-8c92f61c00eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.791615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e130c4c-ae2a-47b1-b4ff-8c92f61c00eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:45.793502 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e130c4c-ae2a-47b1-b4ff-8c92f61c00eb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:45.797339 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-15e3eb2d-a7ab-495b-9055-e8f3afc0d5d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:45.810690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 239/464] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:45.811666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3eb2d-a7ab-495b-9055-e8f3afc0d5d2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:45.828116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-7e130c4c-ae2a-47b1-b4ff-8c92f61c00eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:45.832637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3eb2d-a7ab-495b-9055-e8f3afc0d5d2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:45.833319 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 226/465] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:45.836266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e130c4c-ae2a-47b1-b4ff-8c92f61c00eb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:45.854262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56723c-b8fc-44b8-8ea9-b1c1eb08ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:45.855066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56723c-b8fc-44b8-8ea9-b1c1eb08ce65 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.855352 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56723c-b8fc-44b8-8ea9-b1c1eb08ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.855625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56723c-b8fc-44b8-8ea9-b1c1eb08ce65 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.856376 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56723c-b8fc-44b8-8ea9-b1c1eb08ce65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:45.856682 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56723c-b8fc-44b8-8ea9-b1c1eb08ce65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:45.858316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56723c-b8fc-44b8-8ea9-b1c1eb08ce65 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:45.865191 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e130c4c-ae2a-47b1-b4ff-8c92f61c00eb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:45.875715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e03a01-d239-4071-bf7e-2dbbb925f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:45.876505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e03a01-d239-4071-bf7e-2dbbb925f6da admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.876791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e03a01-d239-4071-bf7e-2dbbb925f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.877062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e03a01-d239-4071-bf7e-2dbbb925f6da admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.877809 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e03a01-d239-4071-bf7e-2dbbb925f6da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:45.878113 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e03a01-d239-4071-bf7e-2dbbb925f6da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:45.879166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-29e03a01-d239-4071-bf7e-2dbbb925f6da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:45.879166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:56:45.879166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:56:45.880039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e03a01-d239-4071-bf7e-2dbbb925f6da admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:45.888275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 240/466] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:45.895838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56723c-b8fc-44b8-8ea9-b1c1eb08ce65 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:45.909816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56723c-b8fc-44b8-8ea9-b1c1eb08ce65 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:45.917310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c5b76-9359-4809-b0de-0521c19946a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:45.917993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c5b76-9359-4809-b0de-0521c19946a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.918270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c5b76-9359-4809-b0de-0521c19946a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.918650 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c5b76-9359-4809-b0de-0521c19946a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.919384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c5b76-9359-4809-b0de-0521c19946a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:45.921298 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c5b76-9359-4809-b0de-0521c19946a6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:45.924816 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 227/467] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:45.933882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e03a01-d239-4071-bf7e-2dbbb925f6da admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:45.945074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e03a01-d239-4071-bf7e-2dbbb925f6da admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:45.953468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca0db8-a2d3-418e-98a2-ea216de433ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:45.954221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0db8-a2d3-418e-98a2-ea216de433ed admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:45.954522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0db8-a2d3-418e-98a2-ea216de433ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:45.955264 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0db8-a2d3-418e-98a2-ea216de433ed admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:45.955701 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 241/468] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:56:45 2021] POST /identity/v3/users => generated 246 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 00:56:45.958432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca0db8-a2d3-418e-98a2-ea216de433ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:45.958432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca0db8-a2d3-418e-98a2-ea216de433ed admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:45.985370 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 228/469] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:56:45 2021] POST /identity/v3/users => generated 248 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:56:46.094779 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbfde0-331c-4655-97b9-687ff7bac1cc None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:46.095707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbfde0-331c-4655-97b9-687ff7bac1cc None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:46.095995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbfde0-331c-4655-97b9-687ff7bac1cc None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:46.098530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 242/470] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:46.105072 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1bde-91a7-4239-a139-338522a63bf5 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:46.105341 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1bde-91a7-4239-a139-338522a63bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:46.105553 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1bde-91a7-4239-a139-338522a63bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:46.125966 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e19f1bde-91a7-4239-a139-338522a63bf5 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:46.127789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e19f1bde-91a7-4239-a139-338522a63bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:46.142588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 229/471] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:46.163437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbfde0-331c-4655-97b9-687ff7bac1cc None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:46.176722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbfde0-331c-4655-97b9-687ff7bac1cc None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:46.181314 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873216be-a384-4ef0-ba15-75fdcc2450ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:46.182128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873216be-a384-4ef0-ba15-75fdcc2450ad admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:46.182436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873216be-a384-4ef0-ba15-75fdcc2450ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:46.182713 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873216be-a384-4ef0-ba15-75fdcc2450ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:46.196515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873216be-a384-4ef0-ba15-75fdcc2450ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:46.198504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873216be-a384-4ef0-ba15-75fdcc2450ad admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:46.222337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-873216be-a384-4ef0-ba15-75fdcc2450ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:46.227170 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 243/472] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:46.231897 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f1bde-91a7-4239-a139-338522a63bf5 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:46.242872 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f1bde-91a7-4239-a139-338522a63bf5 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:46.248353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddaaae-721a-48c2-aef8-46cc6e30380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:46.248353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddaaae-721a-48c2-aef8-46cc6e30380c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:46.248741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddaaae-721a-48c2-aef8-46cc6e30380c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:46.248741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddaaae-721a-48c2-aef8-46cc6e30380c admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:46.249464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddaaae-721a-48c2-aef8-46cc6e30380c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:46.249935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddaaae-721a-48c2-aef8-46cc6e30380c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:46.252211 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddaaae-721a-48c2-aef8-46cc6e30380c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:46.266650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 230/473] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:46.271060 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873216be-a384-4ef0-ba15-75fdcc2450ad admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:46.281803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873216be-a384-4ef0-ba15-75fdcc2450ad admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:46.288343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef929eac-f6b1-4de5-badb-89d6476b8307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:46.289004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef929eac-f6b1-4de5-badb-89d6476b8307 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:46.289284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef929eac-f6b1-4de5-badb-89d6476b8307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:46.289559 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef929eac-f6b1-4de5-badb-89d6476b8307 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:46.290285 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef929eac-f6b1-4de5-badb-89d6476b8307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:46.292248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef929eac-f6b1-4de5-badb-89d6476b8307 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:46.317601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 244/474] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:56:46 2021] POST /identity/v3/users => generated 249 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:56:46.763930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecddc0d-b465-4b59-bcaa-b006800619db None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:46.764434 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecddc0d-b465-4b59-bcaa-b006800619db None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:46.764510 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecddc0d-b465-4b59-bcaa-b006800619db None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:46.766513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 231/475] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:46.772183 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff220e-9844-430b-8f71-f8c136719ac4 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:46.772606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff220e-9844-430b-8f71-f8c136719ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:46.772797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff220e-9844-430b-8f71-f8c136719ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:46.794834 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e2ff220e-9844-430b-8f71-f8c136719ac4 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:46.796025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e2ff220e-9844-430b-8f71-f8c136719ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:46.808327 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 245/476] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:46.833933 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecddc0d-b465-4b59-bcaa-b006800619db None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:46.862804 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecddc0d-b465-4b59-bcaa-b006800619db None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:46.867204 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4cc36-737b-4a3f-b949-b26efff2dadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:46.867865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4cc36-737b-4a3f-b949-b26efff2dadb admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:46.868145 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4cc36-737b-4a3f-b949-b26efff2dadb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:46.868420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4cc36-737b-4a3f-b949-b26efff2dadb admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:46.869194 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4cc36-737b-4a3f-b949-b26efff2dadb admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:46.870837 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4cc36-737b-4a3f-b949-b26efff2dadb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:46.878642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.sql.core [None req-b6a4cc36-737b-4a3f-b949-b26efff2dadb admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 09 00:56:46.878642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 09 00:56:46.878642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [parameters: {'id': '980e7d7433f7495d8f1c4b63f1859fd4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 09 00:56:46.878642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79330) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 09 00:56:46.894160 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-b6a4cc36-737b-4a3f-b949-b26efff2dadb admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 09 00:56:46.895869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 232/477] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 00:56:46 2021] POST /identity/v3/roles => generated 144 bytes in 62 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:46.902828 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff220e-9844-430b-8f71-f8c136719ac4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:46.915373 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff220e-9844-430b-8f71-f8c136719ac4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:46.927562 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27467587-2235-4ec7-81ed-510a6be7d561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:46.928372 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27467587-2235-4ec7-81ed-510a6be7d561 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:46.928647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27467587-2235-4ec7-81ed-510a6be7d561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:46.928917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27467587-2235-4ec7-81ed-510a6be7d561 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:46.947245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27467587-2235-4ec7-81ed-510a6be7d561 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:46.954495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-27467587-2235-4ec7-81ed-510a6be7d561 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 09 00:56:46.956521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 246/478] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:56:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:46.962903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4cc36-737b-4a3f-b949-b26efff2dadb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:46.977010 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4cc36-737b-4a3f-b949-b26efff2dadb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:46.986862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f974e7-f6e1-4c4a-b89a-9f2b3c9d26a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:46.987792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f974e7-f6e1-4c4a-b89a-9f2b3c9d26a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:46.988075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f974e7-f6e1-4c4a-b89a-9f2b3c9d26a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:46.988349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f974e7-f6e1-4c4a-b89a-9f2b3c9d26a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:46.989120 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f974e7-f6e1-4c4a-b89a-9f2b3c9d26a6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:46.989423 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f974e7-f6e1-4c4a-b89a-9f2b3c9d26a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:46.991076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f974e7-f6e1-4c4a-b89a-9f2b3c9d26a6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:47.004833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 233/479] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:48.640373 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28f5f9-5ab9-4011-8d35-577838a8bcb9 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:48.640890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28f5f9-5ab9-4011-8d35-577838a8bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:48.641001 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28f5f9-5ab9-4011-8d35-577838a8bcb9 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:48.643545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 247/480] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:48.649476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a1d73-8d5d-4982-a834-156b3ea7bcb6 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:48.649870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a1d73-8d5d-4982-a834-156b3ea7bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:48.650034 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a1d73-8d5d-4982-a834-156b3ea7bcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:48.673969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-4a2a1d73-8d5d-4982-a834-156b3ea7bcb6 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:48.675492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4a2a1d73-8d5d-4982-a834-156b3ea7bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:48.685778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 234/481] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:48.721612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28f5f9-5ab9-4011-8d35-577838a8bcb9 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:48.739862 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28f5f9-5ab9-4011-8d35-577838a8bcb9 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:48.744384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109fa10-0562-465d-ab3b-e33610727eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:48.745180 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109fa10-0562-465d-ab3b-e33610727eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:48.745463 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109fa10-0562-465d-ab3b-e33610727eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:48.745741 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109fa10-0562-465d-ab3b-e33610727eb6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:48.768580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109fa10-0562-465d-ab3b-e33610727eb6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:48.775545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-f109fa10-0562-465d-ab3b-e33610727eb6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:48.776821 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 248/482] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:48.783240 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a1d73-8d5d-4982-a834-156b3ea7bcb6 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:48.800285 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a1d73-8d5d-4982-a834-156b3ea7bcb6 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:48.810354 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72626d-510b-4a15-b805-b733657b082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:48.811301 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72626d-510b-4a15-b805-b733657b082e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:48.811783 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72626d-510b-4a15-b805-b733657b082e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:48.812248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72626d-510b-4a15-b805-b733657b082e admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:48.813194 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72626d-510b-4a15-b805-b733657b082e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:48.813750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72626d-510b-4a15-b805-b733657b082e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:48.815558 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72626d-510b-4a15-b805-b733657b082e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:48.829924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 235/483] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:48.835936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109fa10-0562-465d-ab3b-e33610727eb6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:48.864460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109fa10-0562-465d-ab3b-e33610727eb6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:48.874507 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc241a-9d96-475b-b37d-8c735ad0148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:48.875296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc241a-9d96-475b-b37d-8c735ad0148a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:48.875576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc241a-9d96-475b-b37d-8c735ad0148a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:48.875850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc241a-9d96-475b-b37d-8c735ad0148a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:48.896212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc241a-9d96-475b-b37d-8c735ad0148a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:48.897965 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc241a-9d96-475b-b37d-8c735ad0148a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:48.917379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-00cc241a-9d96-475b-b37d-8c735ad0148a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:48.918803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 249/484] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:48.924716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72626d-510b-4a15-b805-b733657b082e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:48.940031 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72626d-510b-4a15-b805-b733657b082e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:48.950014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fd6a4-1950-43b1-ac57-22cd9b42d287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:48.950974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fd6a4-1950-43b1-ac57-22cd9b42d287 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:48.951533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fd6a4-1950-43b1-ac57-22cd9b42d287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:48.951995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fd6a4-1950-43b1-ac57-22cd9b42d287 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:48.952969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fd6a4-1950-43b1-ac57-22cd9b42d287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:48.953314 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4149e92-ca79-4913-8ee0-4f2b2f795aee None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:48.953599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4149e92-ca79-4913-8ee0-4f2b2f795aee None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:48.953874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4149e92-ca79-4913-8ee0-4f2b2f795aee None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:48.954182 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fd6a4-1950-43b1-ac57-22cd9b42d287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:48.955711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 250/485] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:48.956333 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fd6a4-1950-43b1-ac57-22cd9b42d287 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:48.962851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139811-224d-4e4b-8294-e01018e888f0 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:48.963139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139811-224d-4e4b-8294-e01018e888f0 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:48.963413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139811-224d-4e4b-8294-e01018e888f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:48.980354 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 236/486] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:48.987692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fd6a4-1950-43b1-ac57-22cd9b42d287 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:48.992755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-37139811-224d-4e4b-8294-e01018e888f0 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:48.993975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-37139811-224d-4e4b-8294-e01018e888f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:48.997451 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fd6a4-1950-43b1-ac57-22cd9b42d287 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.002150 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cd6ac-05e7-4e83-95c2-498860e9a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.002315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 251/487] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:49.003744 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b367b06-1dfc-4355-8e81-b2c817cacd6f None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.004128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b367b06-1dfc-4355-8e81-b2c817cacd6f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.004522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b367b06-1dfc-4355-8e81-b2c817cacd6f None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.006283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 252/488] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:49.007052 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cd6ac-05e7-4e83-95c2-498860e9a731 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.007338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cd6ac-05e7-4e83-95c2-498860e9a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.007656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cd6ac-05e7-4e83-95c2-498860e9a731 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.012177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2d505-03a3-44a5-8118-701ac361ac52 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.012563 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2d505-03a3-44a5-8118-701ac361ac52 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.012941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2d505-03a3-44a5-8118-701ac361ac52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.019522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cd6ac-05e7-4e83-95c2-498860e9a731 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.021611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cd6ac-05e7-4e83-95c2-498860e9a731 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.036704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-85d2d505-03a3-44a5-8118-701ac361ac52 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:49.037911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-85d2d505-03a3-44a5-8118-701ac361ac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:49.046575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 253/489] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:49.046803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-4b5cd6ac-05e7-4e83-95c2-498860e9a731 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 09 00:56:49.047426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2d505-03a3-44a5-8118-701ac361ac52 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.054527 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 237/490] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:48 2021] GET /identity/v3/users/glance => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:49.057938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2d505-03a3-44a5-8118-701ac361ac52 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.060449 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cd6ac-05e7-4e83-95c2-498860e9a731 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.071697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed02541-119f-4e0a-9beb-3e305f157a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.072483 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02541-119f-4e0a-9beb-3e305f157a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.072760 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02541-119f-4e0a-9beb-3e305f157a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.073074 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02541-119f-4e0a-9beb-3e305f157a88 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.074917 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cd6ac-05e7-4e83-95c2-498860e9a731 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.087186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e123f6e-344e-4068-8da4-348a2ac14a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.088084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed02541-119f-4e0a-9beb-3e305f157a88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:49.088261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e123f6e-344e-4068-8da4-348a2ac14a06 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.088468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e123f6e-344e-4068-8da4-348a2ac14a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.088753 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e123f6e-344e-4068-8da4-348a2ac14a06 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.089721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e123f6e-344e-4068-8da4-348a2ac14a06 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.090038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e123f6e-344e-4068-8da4-348a2ac14a06 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.091205 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-3e123f6e-344e-4068-8da4-348a2ac14a06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:49.091205 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:56:49.091205 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:56:49.092409 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e123f6e-344e-4068-8da4-348a2ac14a06 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.094905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-bed02541-119f-4e0a-9beb-3e305f157a88 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:49.096607 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 254/491] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:49.097361 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed02541-119f-4e0a-9beb-3e305f157a88 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.111774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed02541-119f-4e0a-9beb-3e305f157a88 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.116688 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15616ee3-acbc-4f60-9cb9-64392ad3fe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.117507 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15616ee3-acbc-4f60-9cb9-64392ad3fe15 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.117783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15616ee3-acbc-4f60-9cb9-64392ad3fe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.118105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15616ee3-acbc-4f60-9cb9-64392ad3fe15 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.129692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15616ee3-acbc-4f60-9cb9-64392ad3fe15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:49.136565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-15616ee3-acbc-4f60-9cb9-64392ad3fe15 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:49.137533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 238/492] 10.222.0.23 () {56 vars in 1158 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.137962 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 255/493] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:49.139232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e123f6e-344e-4068-8da4-348a2ac14a06 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.148793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15616ee3-acbc-4f60-9cb9-64392ad3fe15 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.156275 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e123f6e-344e-4068-8da4-348a2ac14a06 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.158691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15616ee3-acbc-4f60-9cb9-64392ad3fe15 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.162321 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8302645-a310-48b7-9cde-b54c539f80c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.163218 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028643a6-6791-4c72-9f06-2e4d52a436c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.163575 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8302645-a310-48b7-9cde-b54c539f80c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.163834 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028643a6-6791-4c72-9f06-2e4d52a436c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.164163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028643a6-6791-4c72-9f06-2e4d52a436c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.164489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028643a6-6791-4c72-9f06-2e4d52a436c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.164680 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8302645-a310-48b7-9cde-b54c539f80c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.165261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8302645-a310-48b7-9cde-b54c539f80c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.166294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8302645-a310-48b7-9cde-b54c539f80c4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.166834 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8302645-a310-48b7-9cde-b54c539f80c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.168627 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8302645-a310-48b7-9cde-b54c539f80c4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.175480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028643a6-6791-4c72-9f06-2e4d52a436c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.177468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028643a6-6791-4c72-9f06-2e4d52a436c9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.178112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 239/494] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.178935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8302645-a310-48b7-9cde-b54c539f80c4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.188045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 256/495] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 09 00:56:49.194560 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028643a6-6791-4c72-9f06-2e4d52a436c9 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.194718 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8302645-a310-48b7-9cde-b54c539f80c4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.199414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e35c6-4643-406c-a3d9-5371f2b1fa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.200161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e35c6-4643-406c-a3d9-5371f2b1fa09 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.200441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e35c6-4643-406c-a3d9-5371f2b1fa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.200716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e35c6-4643-406c-a3d9-5371f2b1fa09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.201583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e35c6-4643-406c-a3d9-5371f2b1fa09 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.202011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e35c6-4643-406c-a3d9-5371f2b1fa09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.203810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e35c6-4643-406c-a3d9-5371f2b1fa09 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.207798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028643a6-6791-4c72-9f06-2e4d52a436c9 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.214843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec44dc-c80c-4f1a-bedb-34135e579c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.216135 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec44dc-c80c-4f1a-bedb-34135e579c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.216247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 240/496] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.216720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec44dc-c80c-4f1a-bedb-34135e579c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.217232 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec44dc-c80c-4f1a-bedb-34135e579c5f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.217348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e35c6-4643-406c-a3d9-5371f2b1fa09 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.228853 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e35c6-4643-406c-a3d9-5371f2b1fa09 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.231573 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec44dc-c80c-4f1a-bedb-34135e579c5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.233342 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62f0c8-a169-4cc7-8e29-757f4530de91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.233996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec44dc-c80c-4f1a-bedb-34135e579c5f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.234172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62f0c8-a169-4cc7-8e29-757f4530de91 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.234441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62f0c8-a169-4cc7-8e29-757f4530de91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.234717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62f0c8-a169-4cc7-8e29-757f4530de91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.246514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62f0c8-a169-4cc7-8e29-757f4530de91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.248445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62f0c8-a169-4cc7-8e29-757f4530de91 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.254040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-37ec44dc-c80c-4f1a-bedb-34135e579c5f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:49.255534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 257/497] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:49.256510 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec44dc-c80c-4f1a-bedb-34135e579c5f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.269905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-ed62f0c8-a169-4cc7-8e29-757f4530de91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:49.270614 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec44dc-c80c-4f1a-bedb-34135e579c5f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.274396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 241/498] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:49.274396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62f0c8-a169-4cc7-8e29-757f4530de91 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.280727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3e694-7dc3-4bb9-bbd3-347d0b5fee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.281781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3e694-7dc3-4bb9-bbd3-347d0b5fee90 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.282267 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3e694-7dc3-4bb9-bbd3-347d0b5fee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.283418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3e694-7dc3-4bb9-bbd3-347d0b5fee90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.283654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62f0c8-a169-4cc7-8e29-757f4530de91 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.288211 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25d841-aa46-461f-afb4-068cced778ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.288887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25d841-aa46-461f-afb4-068cced778ae admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.289169 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25d841-aa46-461f-afb4-068cced778ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.289498 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25d841-aa46-461f-afb4-068cced778ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.290224 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25d841-aa46-461f-afb4-068cced778ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.290591 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25d841-aa46-461f-afb4-068cced778ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.292317 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25d841-aa46-461f-afb4-068cced778ae admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.296842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3e694-7dc3-4bb9-bbd3-347d0b5fee90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.299320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3e694-7dc3-4bb9-bbd3-347d0b5fee90 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.305074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 242/499] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.310862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25d841-aa46-461f-afb4-068cced778ae admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.321015 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25d841-aa46-461f-afb4-068cced778ae admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.321556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-e3e3e694-7dc3-4bb9-bbd3-347d0b5fee90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:49.323587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 258/500] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:49.324604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3e694-7dc3-4bb9-bbd3-347d0b5fee90 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.326161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755b54-24bb-4d49-8ff8-62749f016b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.326903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755b54-24bb-4d49-8ff8-62749f016b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.327184 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755b54-24bb-4d49-8ff8-62749f016b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.327460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755b54-24bb-4d49-8ff8-62749f016b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.328467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755b54-24bb-4d49-8ff8-62749f016b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.328577 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755b54-24bb-4d49-8ff8-62749f016b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.331101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755b54-24bb-4d49-8ff8-62749f016b44 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.337578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3e694-7dc3-4bb9-bbd3-347d0b5fee90 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.343152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92571459-f906-4861-ab60-62a585e03a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.344230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92571459-f906-4861-ab60-62a585e03a38 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.344354 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 243/501] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.349337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755b54-24bb-4d49-8ff8-62749f016b44 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.349889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92571459-f906-4861-ab60-62a585e03a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.350403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92571459-f906-4861-ab60-62a585e03a38 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.355336 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755b54-24bb-4d49-8ff8-62749f016b44 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.359683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bac05f-df48-4e53-88d3-11bb436e3596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.360070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92571459-f906-4861-ab60-62a585e03a38 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.360327 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bac05f-df48-4e53-88d3-11bb436e3596 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.361227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bac05f-df48-4e53-88d3-11bb436e3596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.361637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bac05f-df48-4e53-88d3-11bb436e3596 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.362634 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bac05f-df48-4e53-88d3-11bb436e3596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.362937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bac05f-df48-4e53-88d3-11bb436e3596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.364385 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92571459-f906-4861-ab60-62a585e03a38 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.364494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bac05f-df48-4e53-88d3-11bb436e3596 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.376724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 244/502] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.377643 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bac05f-df48-4e53-88d3-11bb436e3596 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.379863 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-92571459-f906-4861-ab60-62a585e03a38 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 09 00:56:49.381595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 259/503] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:49.382730 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92571459-f906-4861-ab60-62a585e03a38 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.393414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bac05f-df48-4e53-88d3-11bb436e3596 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.397949 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd9562-78d6-4803-86ec-ebcf0f0d3cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.398856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd9562-78d6-4803-86ec-ebcf0f0d3cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.399084 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd9562-78d6-4803-86ec-ebcf0f0d3cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.399399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd9562-78d6-4803-86ec-ebcf0f0d3cf3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.400212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92571459-f906-4861-ab60-62a585e03a38 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.404945 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c498de-6fb6-4c8c-ad95-aae8683f5d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.405958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c498de-6fb6-4c8c-ad95-aae8683f5d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.406492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c498de-6fb6-4c8c-ad95-aae8683f5d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.406970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c498de-6fb6-4c8c-ad95-aae8683f5d35 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.407756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd9562-78d6-4803-86ec-ebcf0f0d3cf3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.410028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd9562-78d6-4803-86ec-ebcf0f0d3cf3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.415760 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c498de-6fb6-4c8c-ad95-aae8683f5d35 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.417980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c498de-6fb6-4c8c-ad95-aae8683f5d35 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.424248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-5afd9562-78d6-4803-86ec-ebcf0f0d3cf3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:49.425820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 245/504] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:49.430480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd9562-78d6-4803-86ec-ebcf0f0d3cf3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.436642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd9562-78d6-4803-86ec-ebcf0f0d3cf3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.438387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-46c498de-6fb6-4c8c-ad95-aae8683f5d35 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 09 00:56:49.439978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 260/505] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/users/cinder => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:49.440960 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c498de-6fb6-4c8c-ad95-aae8683f5d35 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.441293 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32290c5-15d9-4da8-8a23-4fcc8524a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.442214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32290c5-15d9-4da8-8a23-4fcc8524a056 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.442582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32290c5-15d9-4da8-8a23-4fcc8524a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.442861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32290c5-15d9-4da8-8a23-4fcc8524a056 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.444145 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32290c5-15d9-4da8-8a23-4fcc8524a056 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.444145 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32290c5-15d9-4da8-8a23-4fcc8524a056 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.446020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32290c5-15d9-4da8-8a23-4fcc8524a056 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.452763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c498de-6fb6-4c8c-ad95-aae8683f5d35 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.459505 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0cfb5-9029-404f-9330-5e8cb12b5909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.460522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0cfb5-9029-404f-9330-5e8cb12b5909 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.461007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0cfb5-9029-404f-9330-5e8cb12b5909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.461902 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0cfb5-9029-404f-9330-5e8cb12b5909 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.463256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0cfb5-9029-404f-9330-5e8cb12b5909 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.463893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0cfb5-9029-404f-9330-5e8cb12b5909 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.465187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-43d0cfb5-9029-404f-9330-5e8cb12b5909 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:49.465187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:56:49.465187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:56:49.466012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 246/506] 10.222.0.23 () {56 vars in 1154 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.466873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32290c5-15d9-4da8-8a23-4fcc8524a056 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.467700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0cfb5-9029-404f-9330-5e8cb12b5909 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.476901 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32290c5-15d9-4da8-8a23-4fcc8524a056 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.481466 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aa007-ac0a-43fd-9f5a-951632505c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.482279 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aa007-ac0a-43fd-9f5a-951632505c1c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.482746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aa007-ac0a-43fd-9f5a-951632505c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.483188 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aa007-ac0a-43fd-9f5a-951632505c1c admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.484164 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59aa007-ac0a-43fd-9f5a-951632505c1c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.484613 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59aa007-ac0a-43fd-9f5a-951632505c1c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.487562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59aa007-ac0a-43fd-9f5a-951632505c1c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.491070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 261/507] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.497628 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0cfb5-9029-404f-9330-5e8cb12b5909 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.507897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0cfb5-9029-404f-9330-5e8cb12b5909 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.508724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 247/508] 10.222.0.23 () {56 vars in 1158 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.509787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aa007-ac0a-43fd-9f5a-951632505c1c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.513319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660932a-55d6-4cb9-8955-e641030632aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.514085 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660932a-55d6-4cb9-8955-e641030632aa admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.514555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660932a-55d6-4cb9-8955-e641030632aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.514935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660932a-55d6-4cb9-8955-e641030632aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.521403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aa007-ac0a-43fd-9f5a-951632505c1c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.525077 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660932a-55d6-4cb9-8955-e641030632aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.526116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe659ca0-468e-4300-8cf5-c812afce9f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.526924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe659ca0-468e-4300-8cf5-c812afce9f3e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.527326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660932a-55d6-4cb9-8955-e641030632aa admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.527468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe659ca0-468e-4300-8cf5-c812afce9f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.527862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe659ca0-468e-4300-8cf5-c812afce9f3e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.528841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe659ca0-468e-4300-8cf5-c812afce9f3e admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=3d001733477f499e937ba90e7e50ba33) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.529285 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe659ca0-468e-4300-8cf5-c812afce9f3e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.531277 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe659ca0-468e-4300-8cf5-c812afce9f3e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.537372 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 248/509] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/role_assignments?user.id=3d001733477f499e937ba90e7e50ba33&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.538313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe659ca0-468e-4300-8cf5-c812afce9f3e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.542689 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 262/510] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:49.543774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660932a-55d6-4cb9-8955-e641030632aa admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.549289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe659ca0-468e-4300-8cf5-c812afce9f3e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.553932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e37b1-1cc2-42ba-aacc-f48231cb8301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.554935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e37b1-1cc2-42ba-aacc-f48231cb8301 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.555440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e37b1-1cc2-42ba-aacc-f48231cb8301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.555911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e37b1-1cc2-42ba-aacc-f48231cb8301 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.560585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660932a-55d6-4cb9-8955-e641030632aa admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.565677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e37b1-1cc2-42ba-aacc-f48231cb8301 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.568056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e37b1-1cc2-42ba-aacc-f48231cb8301 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.568528 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4001-1f7d-4bdf-8d2f-60dce810aea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.569384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4001-1f7d-4bdf-8d2f-60dce810aea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.569669 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4001-1f7d-4bdf-8d2f-60dce810aea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.570000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4001-1f7d-4bdf-8d2f-60dce810aea4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.579233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 249/511] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:49.586419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e37b1-1cc2-42ba-aacc-f48231cb8301 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.595639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e37b1-1cc2-42ba-aacc-f48231cb8301 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.595955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4001-1f7d-4bdf-8d2f-60dce810aea4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.598028 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4001-1f7d-4bdf-8d2f-60dce810aea4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.600704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20ff47-29b8-4924-83ea-a2498169db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.601590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20ff47-29b8-4924-83ea-a2498169db55 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.601871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20ff47-29b8-4924-83ea-a2498169db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.602146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20ff47-29b8-4924-83ea-a2498169db55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.614999 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20ff47-29b8-4924-83ea-a2498169db55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.616931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20ff47-29b8-4924-83ea-a2498169db55 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.623530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-238e4001-1f7d-4bdf-8d2f-60dce810aea4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:49.624756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 263/512] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:49.632256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1230037-be82-4df2-aa97-6d28d31a6a02 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.632548 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1230037-be82-4df2-aa97-6d28d31a6a02 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.632829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1230037-be82-4df2-aa97-6d28d31a6a02 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.634890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 264/513] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:49.635608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1230037-be82-4df2-aa97-6d28d31a6a02 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.640342 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-4b20ff47-29b8-4924-83ea-a2498169db55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:49.642426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 250/514] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:49.643702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186d721-6a80-4197-9b05-8a9b18cd219f None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.643986 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186d721-6a80-4197-9b05-8a9b18cd219f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.644261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186d721-6a80-4197-9b05-8a9b18cd219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.651643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1230037-be82-4df2-aa97-6d28d31a6a02 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.661775 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f06c0-f64d-45c9-af4f-b469400ab27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.662723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f06c0-f64d-45c9-af4f-b469400ab27c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.663091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f06c0-f64d-45c9-af4f-b469400ab27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.663433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f06c0-f64d-45c9-af4f-b469400ab27c admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.664265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f06c0-f64d-45c9-af4f-b469400ab27c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.664529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-9186d721-6a80-4197-9b05-8a9b18cd219f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:49.665047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f06c0-f64d-45c9-af4f-b469400ab27c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.665815 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9186d721-6a80-4197-9b05-8a9b18cd219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:49.666519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f06c0-f64d-45c9-af4f-b469400ab27c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.676111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 251/515] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:49.677126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186d721-6a80-4197-9b05-8a9b18cd219f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.688254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186d721-6a80-4197-9b05-8a9b18cd219f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.692067 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 265/516] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.694664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39a157-42d6-4abf-9ceb-f00a8daefcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.695394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39a157-42d6-4abf-9ceb-f00a8daefcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.695679 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39a157-42d6-4abf-9ceb-f00a8daefcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.695961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39a157-42d6-4abf-9ceb-f00a8daefcc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.696784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39a157-42d6-4abf-9ceb-f00a8daefcc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.697145 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39a157-42d6-4abf-9ceb-f00a8daefcc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.697893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f06c0-f64d-45c9-af4f-b469400ab27c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.699065 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39a157-42d6-4abf-9ceb-f00a8daefcc2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.715937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 252/517] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.718415 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f06c0-f64d-45c9-af4f-b469400ab27c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.722635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39a157-42d6-4abf-9ceb-f00a8daefcc2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.725914 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543496ea-0f54-4b9e-94b1-8eb62caa72dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.726762 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543496ea-0f54-4b9e-94b1-8eb62caa72dd admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.727040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543496ea-0f54-4b9e-94b1-8eb62caa72dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.727321 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543496ea-0f54-4b9e-94b1-8eb62caa72dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.735474 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39a157-42d6-4abf-9ceb-f00a8daefcc2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.737233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543496ea-0f54-4b9e-94b1-8eb62caa72dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.739447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543496ea-0f54-4b9e-94b1-8eb62caa72dd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.742026 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf5c32-f17c-46fd-8642-ec36d0061191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.743673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf5c32-f17c-46fd-8642-ec36d0061191 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.744210 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf5c32-f17c-46fd-8642-ec36d0061191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.744699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf5c32-f17c-46fd-8642-ec36d0061191 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.754241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf5c32-f17c-46fd-8642-ec36d0061191 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.756638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-543496ea-0f54-4b9e-94b1-8eb62caa72dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:49.757270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf5c32-f17c-46fd-8642-ec36d0061191 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.758514 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 266/518] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:49.759454 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543496ea-0f54-4b9e-94b1-8eb62caa72dd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.770477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543496ea-0f54-4b9e-94b1-8eb62caa72dd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.774971 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5303a-9d92-4adf-9993-66be4cd35ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.775761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5303a-9d92-4adf-9993-66be4cd35ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.776043 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5303a-9d92-4adf-9993-66be4cd35ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.776316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5303a-9d92-4adf-9993-66be4cd35ab1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.776749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-4dbf5c32-f17c-46fd-8642-ec36d0061191 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:49.778517 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 253/519] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:49.779731 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf5c32-f17c-46fd-8642-ec36d0061191 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.794977 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf5c32-f17c-46fd-8642-ec36d0061191 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.796835 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5303a-9d92-4adf-9993-66be4cd35ab1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:49.800648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f3b3c-2b55-434a-bf74-414eb9959efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.801596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f3b3c-2b55-434a-bf74-414eb9959efe admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.802061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f3b3c-2b55-434a-bf74-414eb9959efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.802586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f3b3c-2b55-434a-bf74-414eb9959efe admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.803576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f3b3c-2b55-434a-bf74-414eb9959efe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.804074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f3b3c-2b55-434a-bf74-414eb9959efe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.805188 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-60e5303a-9d92-4adf-9993-66be4cd35ab1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:49.805502 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-0e2f3b3c-2b55-434a-bf74-414eb9959efe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:49.805502 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:56:49.805502 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:56:49.807005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f3b3c-2b55-434a-bf74-414eb9959efe admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.811855 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 267/520] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:49.812842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5303a-9d92-4adf-9993-66be4cd35ab1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.825006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5303a-9d92-4adf-9993-66be4cd35ab1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.830340 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e793dd-fa0c-4001-9d8d-fa1b510421d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.831072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e793dd-fa0c-4001-9d8d-fa1b510421d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.831352 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e793dd-fa0c-4001-9d8d-fa1b510421d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.831680 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e793dd-fa0c-4001-9d8d-fa1b510421d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.832589 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e793dd-fa0c-4001-9d8d-fa1b510421d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.832896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e793dd-fa0c-4001-9d8d-fa1b510421d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.833701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 254/521] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.834762 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f3b3c-2b55-434a-bf74-414eb9959efe admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.835084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e793dd-fa0c-4001-9d8d-fa1b510421d2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.847503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f3b3c-2b55-434a-bf74-414eb9959efe admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.850530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 268/522] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.851579 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e793dd-fa0c-4001-9d8d-fa1b510421d2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.862463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345420-1196-4841-8f6e-d0bd505e8bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.863151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345420-1196-4841-8f6e-d0bd505e8bef admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.863478 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345420-1196-4841-8f6e-d0bd505e8bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.863753 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345420-1196-4841-8f6e-d0bd505e8bef admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.863851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e793dd-fa0c-4001-9d8d-fa1b510421d2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.864682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca345420-1196-4841-8f6e-d0bd505e8bef admin admin] RBAC: Adding query filter params (name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.864931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca345420-1196-4841-8f6e-d0bd505e8bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.866992 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca345420-1196-4841-8f6e-d0bd505e8bef admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.868552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ce246-f97a-4210-9697-4531269f1128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.869158 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ce246-f97a-4210-9697-4531269f1128 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.869726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ce246-f97a-4210-9697-4531269f1128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.869726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ce246-f97a-4210-9697-4531269f1128 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.870684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ce246-f97a-4210-9697-4531269f1128 admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=53d32ba063bc4a719d4c2f67d88ec640) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.871355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ce246-f97a-4210-9697-4531269f1128 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.872793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ce246-f97a-4210-9697-4531269f1128 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.877258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 255/523] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.877938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345420-1196-4841-8f6e-d0bd505e8bef admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.884428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 269/524] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/role_assignments?user.id=53d32ba063bc4a719d4c2f67d88ec640&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.884969 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ce246-f97a-4210-9697-4531269f1128 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.895805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ce246-f97a-4210-9697-4531269f1128 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.896819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345420-1196-4841-8f6e-d0bd505e8bef admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.900818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c54e58-4585-4bc0-811a-a3e002956e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.901870 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c54e58-4585-4bc0-811a-a3e002956e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.902221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c54e58-4585-4bc0-811a-a3e002956e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.902677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c54e58-4585-4bc0-811a-a3e002956e4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.913739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7e54e-a820-45bb-a32d-bc5e7df1b41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.914421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7e54e-a820-45bb-a32d-bc5e7df1b41a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.914707 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7e54e-a820-45bb-a32d-bc5e7df1b41a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.914980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7e54e-a820-45bb-a32d-bc5e7df1b41a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.915825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7e54e-a820-45bb-a32d-bc5e7df1b41a admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=fb5625c813724729bb927c201f23e417) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.916474 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7e54e-a820-45bb-a32d-bc5e7df1b41a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.917999 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7e54e-a820-45bb-a32d-bc5e7df1b41a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.918745 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c54e58-4585-4bc0-811a-a3e002956e4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.920814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c54e58-4585-4bc0-811a-a3e002956e4d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.936821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 256/525] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/role_assignments?user.id=fb5625c813724729bb927c201f23e417&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 259 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.940950 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-44c54e58-4585-4bc0-811a-a3e002956e4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:49.942483 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 270/526] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:49.948653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7e54e-a820-45bb-a32d-bc5e7df1b41a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:49.959988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7e54e-a820-45bb-a32d-bc5e7df1b41a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:49.965007 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c01d0-9159-4501-88c0-939d98e3a79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:49.965899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c01d0-9159-4501-88c0-939d98e3a79e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:49.966249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c01d0-9159-4501-88c0-939d98e3a79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:49.966621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c01d0-9159-4501-88c0-939d98e3a79e admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:49.967511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c01d0-9159-4501-88c0-939d98e3a79e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:49.967886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c01d0-9159-4501-88c0-939d98e3a79e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:49.969622 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c01d0-9159-4501-88c0-939d98e3a79e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:49.984475 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 257/527] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:49.991266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c54e58-4585-4bc0-811a-a3e002956e4d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:50.001967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c54e58-4585-4bc0-811a-a3e002956e4d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:50.007146 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5ffc9-4491-4671-b81f-75561f4ad1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:50.007964 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5ffc9-4491-4671-b81f-75561f4ad1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.008246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5ffc9-4491-4671-b81f-75561f4ad1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.008523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5ffc9-4491-4671-b81f-75561f4ad1a3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.017732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5ffc9-4491-4671-b81f-75561f4ad1a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:50.019965 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5ffc9-4491-4671-b81f-75561f4ad1a3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:50.035892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-09f5ffc9-4491-4671-b81f-75561f4ad1a3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 09 00:56:50.037451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 271/528] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:49 2021] GET /identity/v3/users/neutron => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:50.043710 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c01d0-9159-4501-88c0-939d98e3a79e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:50.054932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c01d0-9159-4501-88c0-939d98e3a79e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:50.059626 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da717304-1462-4d8c-952b-7cd356d1c1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:50.060312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da717304-1462-4d8c-952b-7cd356d1c1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.060596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da717304-1462-4d8c-952b-7cd356d1c1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.060877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da717304-1462-4d8c-952b-7cd356d1c1d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.061743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da717304-1462-4d8c-952b-7cd356d1c1d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:50.062060 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da717304-1462-4d8c-952b-7cd356d1c1d7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:50.064078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da717304-1462-4d8c-952b-7cd356d1c1d7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:50.085811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 258/529] 10.222.0.23 () {56 vars in 1160 bytes} [Thu Dec 9 00:56:50 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:50.091870 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5ffc9-4491-4671-b81f-75561f4ad1a3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:50.106277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5ffc9-4491-4671-b81f-75561f4ad1a3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:50.111728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2eed6-82a4-42da-ae5c-30f15837612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:50.112850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2eed6-82a4-42da-ae5c-30f15837612e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.113130 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2eed6-82a4-42da-ae5c-30f15837612e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.113403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2eed6-82a4-42da-ae5c-30f15837612e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.127520 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2eed6-82a4-42da-ae5c-30f15837612e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:50.129468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2eed6-82a4-42da-ae5c-30f15837612e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:50.139551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 272/530] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:50.146537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da717304-1462-4d8c-952b-7cd356d1c1d7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:50.157103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da717304-1462-4d8c-952b-7cd356d1c1d7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:50.162940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966121b-8818-4b34-8ad4-fca6aa4804eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:50.163752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966121b-8818-4b34-8ad4-fca6aa4804eb admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.164033 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966121b-8818-4b34-8ad4-fca6aa4804eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.164307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966121b-8818-4b34-8ad4-fca6aa4804eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.169394 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e060f5-2601-4dab-b5fc-d79f79bfb017 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.169673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e060f5-2601-4dab-b5fc-d79f79bfb017 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.169949 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e060f5-2601-4dab-b5fc-d79f79bfb017 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.172838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 273/531] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:50.183584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966121b-8818-4b34-8ad4-fca6aa4804eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:50.186050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966121b-8818-4b34-8ad4-fca6aa4804eb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:50.190913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771c71f-dfdd-4e4e-b18c-e18d6c732532 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.191308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771c71f-dfdd-4e4e-b18c-e18d6c732532 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.191470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771c71f-dfdd-4e4e-b18c-e18d6c732532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.207998 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-2966121b-8818-4b34-8ad4-fca6aa4804eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:50.209944 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 259/532] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:50.222412 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966121b-8818-4b34-8ad4-fca6aa4804eb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:50.227042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-7771c71f-dfdd-4e4e-b18c-e18d6c732532 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:50.228432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-7771c71f-dfdd-4e4e-b18c-e18d6c732532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:50.238258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966121b-8818-4b34-8ad4-fca6aa4804eb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:50.247383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 274/533] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:50.248970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f462684-71af-44f0-ab81-f92d7218d4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:50.249645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462684-71af-44f0-ab81-f92d7218d4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.249930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462684-71af-44f0-ab81-f92d7218d4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.250205 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462684-71af-44f0-ab81-f92d7218d4c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.250994 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f462684-71af-44f0-ab81-f92d7218d4c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:50.251361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f462684-71af-44f0-ab81-f92d7218d4c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:50.253411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f462684-71af-44f0-ab81-f92d7218d4c8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:50.266505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 260/534] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:50.273934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771c71f-dfdd-4e4e-b18c-e18d6c732532 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:50.286680 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f462684-71af-44f0-ab81-f92d7218d4c8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:50.287163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771c71f-dfdd-4e4e-b18c-e18d6c732532 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:50.292481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84b28d-b814-4388-aade-90b9f9366e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:50.293271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84b28d-b814-4388-aade-90b9f9366e9f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.293732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84b28d-b814-4388-aade-90b9f9366e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.293836 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84b28d-b814-4388-aade-90b9f9366e9f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.304212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84b28d-b814-4388-aade-90b9f9366e9f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:50.304212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84b28d-b814-4388-aade-90b9f9366e9f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:50.304466 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f462684-71af-44f0-ab81-f92d7218d4c8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:50.309421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bbed3-92fe-4194-a260-3ec4d46d1aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:50.310548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bbed3-92fe-4194-a260-3ec4d46d1aba admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.310849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bbed3-92fe-4194-a260-3ec4d46d1aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.311178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bbed3-92fe-4194-a260-3ec4d46d1aba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.318660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-9e84b28d-b814-4388-aade-90b9f9366e9f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:50.320159 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 275/535] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:50.325582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bbed3-92fe-4194-a260-3ec4d46d1aba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:50.326000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84b28d-b814-4388-aade-90b9f9366e9f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:50.327598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bbed3-92fe-4194-a260-3ec4d46d1aba admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:50.338173 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84b28d-b814-4388-aade-90b9f9366e9f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:50.342668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77178b-3798-4882-9624-ab721cab7208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:50.343299 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77178b-3798-4882-9624-ab721cab7208 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.343580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77178b-3798-4882-9624-ab721cab7208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.343855 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77178b-3798-4882-9624-ab721cab7208 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.344641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77178b-3798-4882-9624-ab721cab7208 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:50.345003 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77178b-3798-4882-9624-ab721cab7208 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:50.346951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-151bbed3-92fe-4194-a260-3ec4d46d1aba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:50.347293 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77178b-3798-4882-9624-ab721cab7208 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:50.348314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 261/536] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:50.355070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bbed3-92fe-4194-a260-3ec4d46d1aba admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:50.366724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bbed3-92fe-4194-a260-3ec4d46d1aba admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:50.367489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 276/537] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:50.373639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77178b-3798-4882-9624-ab721cab7208 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:50.383837 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3127-256e-4e1f-a15f-38276d88349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:50.384505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3127-256e-4e1f-a15f-38276d88349c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.384610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77178b-3798-4882-9624-ab721cab7208 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:50.384836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3127-256e-4e1f-a15f-38276d88349c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.385120 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3127-256e-4e1f-a15f-38276d88349c admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.385854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e3127-256e-4e1f-a15f-38276d88349c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:50.386208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e3127-256e-4e1f-a15f-38276d88349c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:50.387880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e3127-256e-4e1f-a15f-38276d88349c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:50.389725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a2309-bc88-4334-8f78-62c56195c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:50.390593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a2309-bc88-4334-8f78-62c56195c69b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.391081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a2309-bc88-4334-8f78-62c56195c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.391501 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a2309-bc88-4334-8f78-62c56195c69b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.392949 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a2309-bc88-4334-8f78-62c56195c69b admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=0ab73b6f3a1949359549f91e1b708600) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:50.393483 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a2309-bc88-4334-8f78-62c56195c69b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:50.395593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a2309-bc88-4334-8f78-62c56195c69b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:50.402094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 277/538] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:50 2021] GET /identity/v3/role_assignments?user.id=0ab73b6f3a1949359549f91e1b708600&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:50.417292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 262/539] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:50.423934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a2309-bc88-4334-8f78-62c56195c69b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:50.441243 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a2309-bc88-4334-8f78-62c56195c69b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:50.449219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd14be5-1f0e-4a6e-ade7-6bde71aadec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:50.450193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd14be5-1f0e-4a6e-ade7-6bde71aadec4 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:50.450641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd14be5-1f0e-4a6e-ade7-6bde71aadec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:50.451105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd14be5-1f0e-4a6e-ade7-6bde71aadec4 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:50.452000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd14be5-1f0e-4a6e-ade7-6bde71aadec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:50.454155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd14be5-1f0e-4a6e-ade7-6bde71aadec4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:50.492854 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 278/540] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:56:50 2021] POST /identity/v3/users => generated 247 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:56:52.461404 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06a339-8871-4718-a788-edf62f9b5ff8 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.461924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06a339-8871-4718-a788-edf62f9b5ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.462029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06a339-8871-4718-a788-edf62f9b5ff8 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.464002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 263/541] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:52.469367 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228b99a-570e-4782-9c3a-5daf84152cfa None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.469749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228b99a-570e-4782-9c3a-5daf84152cfa None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.470236 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228b99a-570e-4782-9c3a-5daf84152cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.488888 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2228b99a-570e-4782-9c3a-5daf84152cfa None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:52.490069 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2228b99a-570e-4782-9c3a-5daf84152cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:52.502176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 279/542] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:52.537398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06a339-8871-4718-a788-edf62f9b5ff8 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:52.553087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06a339-8871-4718-a788-edf62f9b5ff8 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:52.562964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d7f8d-d3dc-49fa-952c-dce9f97e0ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:52.564420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d7f8d-d3dc-49fa-952c-dce9f97e0ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.564632 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d7f8d-d3dc-49fa-952c-dce9f97e0ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.564845 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d7f8d-d3dc-49fa-952c-dce9f97e0ac1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.575774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d7f8d-d3dc-49fa-952c-dce9f97e0ac1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:52.582665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-311d7f8d-d3dc-49fa-952c-dce9f97e0ac1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:52.583871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 264/543] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:52.590133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228b99a-570e-4782-9c3a-5daf84152cfa None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:52.599222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228b99a-570e-4782-9c3a-5daf84152cfa None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:52.603726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531f2f8-2e18-4213-84bf-2f15d6a7a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:52.604372 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531f2f8-2e18-4213-84bf-2f15d6a7a806 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.604649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531f2f8-2e18-4213-84bf-2f15d6a7a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.604921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531f2f8-2e18-4213-84bf-2f15d6a7a806 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.605664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531f2f8-2e18-4213-84bf-2f15d6a7a806 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:52.605968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531f2f8-2e18-4213-84bf-2f15d6a7a806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:52.607684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531f2f8-2e18-4213-84bf-2f15d6a7a806 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:52.617199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 280/544] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:52.622806 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d7f8d-d3dc-49fa-952c-dce9f97e0ac1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:52.635270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d7f8d-d3dc-49fa-952c-dce9f97e0ac1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:52.642965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46902644-5a68-4f36-91d9-e526045963fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:52.643742 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46902644-5a68-4f36-91d9-e526045963fe admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.644019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46902644-5a68-4f36-91d9-e526045963fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.644290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46902644-5a68-4f36-91d9-e526045963fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.655330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46902644-5a68-4f36-91d9-e526045963fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:52.657174 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46902644-5a68-4f36-91d9-e526045963fe admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:52.679066 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-46902644-5a68-4f36-91d9-e526045963fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:52.680436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 265/545] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:52.686212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531f2f8-2e18-4213-84bf-2f15d6a7a806 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:52.699258 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531f2f8-2e18-4213-84bf-2f15d6a7a806 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:52.707063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acec1b7-8894-49fd-a8c7-b6f8976c3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:52.707784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acec1b7-8894-49fd-a8c7-b6f8976c3cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.708063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acec1b7-8894-49fd-a8c7-b6f8976c3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.708341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acec1b7-8894-49fd-a8c7-b6f8976c3cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.709071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acec1b7-8894-49fd-a8c7-b6f8976c3cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:52.709375 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acec1b7-8894-49fd-a8c7-b6f8976c3cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:52.710991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acec1b7-8894-49fd-a8c7-b6f8976c3cd8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:52.723382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 281/546] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:52.728804 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46902644-5a68-4f36-91d9-e526045963fe admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:52.751866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46902644-5a68-4f36-91d9-e526045963fe admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:52.756827 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53075b-98d5-4e8c-86cf-cc77cbebe7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:52.757657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53075b-98d5-4e8c-86cf-cc77cbebe7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.757935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53075b-98d5-4e8c-86cf-cc77cbebe7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.758206 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53075b-98d5-4e8c-86cf-cc77cbebe7b0 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.770685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53075b-98d5-4e8c-86cf-cc77cbebe7b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:52.772935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fba7f-3dbc-4dc9-9b5b-023915b4974a None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.773218 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fba7f-3dbc-4dc9-9b5b-023915b4974a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.773499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fba7f-3dbc-4dc9-9b5b-023915b4974a None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.775276 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 282/547] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:52.776640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53075b-98d5-4e8c-86cf-cc77cbebe7b0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:52.780786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0598-ddf4-4f50-acd8-71416d18e1ad None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.781071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0598-ddf4-4f50-acd8-71416d18e1ad None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.781351 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0598-ddf4-4f50-acd8-71416d18e1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.801620 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-de53075b-98d5-4e8c-86cf-cc77cbebe7b0 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 09 00:56:52.808660 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 266/548] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:52 2021] GET /identity/v3/users/glance => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:52.815397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53075b-98d5-4e8c-86cf-cc77cbebe7b0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:52.823391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-211f0598-ddf4-4f50-acd8-71416d18e1ad None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:52.824612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-211f0598-ddf4-4f50-acd8-71416d18e1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:52.824942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53075b-98d5-4e8c-86cf-cc77cbebe7b0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:52.829593 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58925408-3955-48e1-bfdc-1d6032739908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:52.830358 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58925408-3955-48e1-bfdc-1d6032739908 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.830662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58925408-3955-48e1-bfdc-1d6032739908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.830933 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58925408-3955-48e1-bfdc-1d6032739908 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.831762 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58925408-3955-48e1-bfdc-1d6032739908 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:52.832062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58925408-3955-48e1-bfdc-1d6032739908 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:52.833868 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58925408-3955-48e1-bfdc-1d6032739908 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:52.854162 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 267/549] 10.222.0.23 () {56 vars in 1158 bytes} [Thu Dec 9 00:56:52 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:52.861114 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 283/550] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:52.862472 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58925408-3955-48e1-bfdc-1d6032739908 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:52.878244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58925408-3955-48e1-bfdc-1d6032739908 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:52.885527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0598-ddf4-4f50-acd8-71416d18e1ad None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:52.888207 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b9387-483e-4de3-9276-56b587b86c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:52.889201 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b9387-483e-4de3-9276-56b587b86c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.889638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b9387-483e-4de3-9276-56b587b86c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.890060 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b9387-483e-4de3-9276-56b587b86c9e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.899361 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0598-ddf4-4f50-acd8-71416d18e1ad None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:52.903516 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b9387-483e-4de3-9276-56b587b86c9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:52.905463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b9387-483e-4de3-9276-56b587b86c9e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:52.915417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41495ce9-190b-4544-bb55-5ee193f3acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:52.916415 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41495ce9-190b-4544-bb55-5ee193f3acf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.916832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41495ce9-190b-4544-bb55-5ee193f3acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.917239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41495ce9-190b-4544-bb55-5ee193f3acf5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.935135 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-221b9387-483e-4de3-9276-56b587b86c9e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:52.938061 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41495ce9-190b-4544-bb55-5ee193f3acf5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:52.943239 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 268/551] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:52.947227 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-41495ce9-190b-4544-bb55-5ee193f3acf5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:52.949053 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b9387-483e-4de3-9276-56b587b86c9e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:52.950035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 284/552] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:52.956731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41495ce9-190b-4544-bb55-5ee193f3acf5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:52.964936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b9387-483e-4de3-9276-56b587b86c9e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:52.972277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41495ce9-190b-4544-bb55-5ee193f3acf5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:52.972929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857a8e-af6b-4d05-903e-b4c9eaf4de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:52.973861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857a8e-af6b-4d05-903e-b4c9eaf4de99 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.974090 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857a8e-af6b-4d05-903e-b4c9eaf4de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.974383 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857a8e-af6b-4d05-903e-b4c9eaf4de99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.975502 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3857a8e-af6b-4d05-903e-b4c9eaf4de99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:52.975905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3857a8e-af6b-4d05-903e-b4c9eaf4de99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:52.977938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3857a8e-af6b-4d05-903e-b4c9eaf4de99 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:52.978502 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374dfe7-f22d-4f1f-9651-b1345b25a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:52.979411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374dfe7-f22d-4f1f-9651-b1345b25a61b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:52.979832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374dfe7-f22d-4f1f-9651-b1345b25a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:52.980276 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374dfe7-f22d-4f1f-9651-b1345b25a61b admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:52.981207 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374dfe7-f22d-4f1f-9651-b1345b25a61b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:52.981686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374dfe7-f22d-4f1f-9651-b1345b25a61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:52.990405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374dfe7-f22d-4f1f-9651-b1345b25a61b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:52.991595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 269/553] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:52.999586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857a8e-af6b-4d05-903e-b4c9eaf4de99 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.001713 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 285/554] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:53.007892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374dfe7-f22d-4f1f-9651-b1345b25a61b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.011149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857a8e-af6b-4d05-903e-b4c9eaf4de99 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.019578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374dfe7-f22d-4f1f-9651-b1345b25a61b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.022315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b8580-6a27-4f36-8d68-886d36e2cff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.023550 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b8580-6a27-4f36-8d68-886d36e2cff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.023840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b8580-6a27-4f36-8d68-886d36e2cff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.024110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b8580-6a27-4f36-8d68-886d36e2cff4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.025014 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18e0fe-5af7-4c63-80ee-268e51042467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.025978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18e0fe-5af7-4c63-80ee-268e51042467 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.026453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18e0fe-5af7-4c63-80ee-268e51042467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.026879 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18e0fe-5af7-4c63-80ee-268e51042467 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.041957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b8580-6a27-4f36-8d68-886d36e2cff4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.045575 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b8580-6a27-4f36-8d68-886d36e2cff4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.048254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18e0fe-5af7-4c63-80ee-268e51042467 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.051415 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18e0fe-5af7-4c63-80ee-268e51042467 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.071882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-406b8580-6a27-4f36-8d68-886d36e2cff4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:53.074131 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 270/555] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:53.082800 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-ec18e0fe-5af7-4c63-80ee-268e51042467 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:53.083863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b8580-6a27-4f36-8d68-886d36e2cff4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.090232 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 286/556] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:53.091510 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6bf2a-38c1-4d36-a648-b7c190a42efd None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.091801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6bf2a-38c1-4d36-a648-b7c190a42efd None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.092082 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6bf2a-38c1-4d36-a648-b7c190a42efd None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.094005 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 287/557] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:53.095142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b8580-6a27-4f36-8d68-886d36e2cff4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.099829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6bf2a-38c1-4d36-a648-b7c190a42efd None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.100403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b5355-e3d8-4878-b8df-504aa8e4b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.101273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b5355-e3d8-4878-b8df-504aa8e4b2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.101767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b5355-e3d8-4878-b8df-504aa8e4b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.102207 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b5355-e3d8-4878-b8df-504aa8e4b2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.103260 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b5355-e3d8-4878-b8df-504aa8e4b2f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:53.103828 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b5355-e3d8-4878-b8df-504aa8e4b2f2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.105868 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b5355-e3d8-4878-b8df-504aa8e4b2f2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.118630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6bf2a-38c1-4d36-a648-b7c190a42efd None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.119902 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 271/558] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:53.121416 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9309d-319f-4579-92bb-c7a11473a295 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.121985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9309d-319f-4579-92bb-c7a11473a295 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.122465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9309d-319f-4579-92bb-c7a11473a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.123278 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853cd9f-c999-4c47-ab11-61a5bc91182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.123928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853cd9f-c999-4c47-ab11-61a5bc91182a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.124207 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853cd9f-c999-4c47-ab11-61a5bc91182a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.124626 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853cd9f-c999-4c47-ab11-61a5bc91182a admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.125538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853cd9f-c999-4c47-ab11-61a5bc91182a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:53.125849 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853cd9f-c999-4c47-ab11-61a5bc91182a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.127712 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853cd9f-c999-4c47-ab11-61a5bc91182a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.141586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 288/559] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:53.143369 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853cd9f-c999-4c47-ab11-61a5bc91182a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.143491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-bdc9309d-319f-4579-92bb-c7a11473a295 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:53.144851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-bdc9309d-319f-4579-92bb-c7a11473a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:53.153332 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 272/560] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:53.154304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9309d-319f-4579-92bb-c7a11473a295 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.159838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853cd9f-c999-4c47-ab11-61a5bc91182a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.170174 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9309d-319f-4579-92bb-c7a11473a295 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.173778 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851445f-2731-42d7-8635-79f593fb8cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.174877 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851445f-2731-42d7-8635-79f593fb8cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.175357 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851445f-2731-42d7-8635-79f593fb8cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.175810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851445f-2731-42d7-8635-79f593fb8cb1 admin admin] PATH_INFO: `/v3/projects/0566d367619740a48d8dca2def78a386/users/3d001733477f499e937ba90e7e50ba33/roles/0de5bfc441494559af3a8cdd798c347e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.182847 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4dbbb-b6c3-4a7c-8580-fcbf7c6ec9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.183877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4dbbb-b6c3-4a7c-8580-fcbf7c6ec9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.184330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4dbbb-b6c3-4a7c-8580-fcbf7c6ec9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.184787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4dbbb-b6c3-4a7c-8580-fcbf7c6ec9c0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.192644 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4dbbb-b6c3-4a7c-8580-fcbf7c6ec9c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.194925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4dbbb-b6c3-4a7c-8580-fcbf7c6ec9c0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.195032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851445f-2731-42d7-8635-79f593fb8cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566d367619740a48d8dca2def78a386, user_id=3d001733477f499e937ba90e7e50ba33, role_id=0de5bfc441494559af3a8cdd798c347e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.198816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851445f-2731-42d7-8635-79f593fb8cb1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.209917 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-39d4dbbb-b6c3-4a7c-8580-fcbf7c6ec9c0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 09 00:56:53.211744 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 273/561] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/users/nova => generated 82 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:53.212672 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4dbbb-b6c3-4a7c-8580-fcbf7c6ec9c0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.215101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 289/562] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:53 2021] PUT /identity/v3/projects/0566d367619740a48d8dca2def78a386/users/3d001733477f499e937ba90e7e50ba33/roles/0de5bfc441494559af3a8cdd798c347e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:53.227184 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4dbbb-b6c3-4a7c-8580-fcbf7c6ec9c0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.229416 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851445f-2731-42d7-8635-79f593fb8cb1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.293754 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b68b0-993b-47f7-8623-4a8d488744ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.294982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b68b0-993b-47f7-8623-4a8d488744ae admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.295445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b68b0-993b-47f7-8623-4a8d488744ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.295894 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b68b0-993b-47f7-8623-4a8d488744ae admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.309432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b68b0-993b-47f7-8623-4a8d488744ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:53.317139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-215b68b0-993b-47f7-8623-4a8d488744ae admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:53.319025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 274/563] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:53.344035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851445f-2731-42d7-8635-79f593fb8cb1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.348793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4fad3-dfb4-4dcc-a28a-24876282715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.349488 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4fad3-dfb4-4dcc-a28a-24876282715a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.349764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4fad3-dfb4-4dcc-a28a-24876282715a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.350038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4fad3-dfb4-4dcc-a28a-24876282715a admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.351537 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4fad3-dfb4-4dcc-a28a-24876282715a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:53.351852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4fad3-dfb4-4dcc-a28a-24876282715a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.352242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b68b0-993b-47f7-8623-4a8d488744ae admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.353161 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-f5d4fad3-dfb4-4dcc-a28a-24876282715a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:56:53.353161 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:56:53.353161 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:56:53.354493 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4fad3-dfb4-4dcc-a28a-24876282715a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.377709 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b68b0-993b-47f7-8623-4a8d488744ae admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.398645 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 290/564] 10.222.0.23 () {56 vars in 1154 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:53.399204 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08d1fb-b9fc-4c02-902d-bf80aedbc871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.399913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08d1fb-b9fc-4c02-902d-bf80aedbc871 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.400193 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08d1fb-b9fc-4c02-902d-bf80aedbc871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.400471 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08d1fb-b9fc-4c02-902d-bf80aedbc871 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.401248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08d1fb-b9fc-4c02-902d-bf80aedbc871 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:53.401553 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08d1fb-b9fc-4c02-902d-bf80aedbc871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.410684 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08d1fb-b9fc-4c02-902d-bf80aedbc871 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.411997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4fad3-dfb4-4dcc-a28a-24876282715a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.414210 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 275/565] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:53.423473 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4fad3-dfb4-4dcc-a28a-24876282715a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.434110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5ebe1-e928-4369-89e5-59d136420347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.435286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5ebe1-e928-4369-89e5-59d136420347 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.435738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5ebe1-e928-4369-89e5-59d136420347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.436222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5ebe1-e928-4369-89e5-59d136420347 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.442822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08d1fb-b9fc-4c02-902d-bf80aedbc871 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.450171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5ebe1-e928-4369-89e5-59d136420347 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.452920 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5ebe1-e928-4369-89e5-59d136420347 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.453435 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08d1fb-b9fc-4c02-902d-bf80aedbc871 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.463501 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a69276-a411-4626-8549-4c5453aa2853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.464125 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a69276-a411-4626-8549-4c5453aa2853 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.464204 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a69276-a411-4626-8549-4c5453aa2853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.465099 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a69276-a411-4626-8549-4c5453aa2853 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.477920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a69276-a411-4626-8549-4c5453aa2853 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.478114 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-21b5ebe1-e928-4369-89e5-59d136420347 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:53.480071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a69276-a411-4626-8549-4c5453aa2853 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.480187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 291/566] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:53.481204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d338d-15ab-48ed-b8ef-4c04912d8de2 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.481523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d338d-15ab-48ed-b8ef-4c04912d8de2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.481800 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d338d-15ab-48ed-b8ef-4c04912d8de2 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.483817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 292/567] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:53.490017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d338d-15ab-48ed-b8ef-4c04912d8de2 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.503603 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d338d-15ab-48ed-b8ef-4c04912d8de2 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.508114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-63a69276-a411-4626-8549-4c5453aa2853 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:53.508288 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddffdab-3241-479a-a410-13ec0b72a412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.508918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddffdab-3241-479a-a410-13ec0b72a412 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.509199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddffdab-3241-479a-a410-13ec0b72a412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.509361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 276/568] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:53.509451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddffdab-3241-479a-a410-13ec0b72a412 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.510201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddffdab-3241-479a-a410-13ec0b72a412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:53.510615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dab469-2f53-42c6-a3da-52a1899df72f None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.510717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddffdab-3241-479a-a410-13ec0b72a412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.510903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dab469-2f53-42c6-a3da-52a1899df72f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.511183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dab469-2f53-42c6-a3da-52a1899df72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.512237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddffdab-3241-479a-a410-13ec0b72a412 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.526128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 293/569] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:53.527068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddffdab-3241-479a-a410-13ec0b72a412 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.535644 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-67dab469-2f53-42c6-a3da-52a1899df72f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:53.536855 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-67dab469-2f53-42c6-a3da-52a1899df72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:53.537233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddffdab-3241-479a-a410-13ec0b72a412 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.541953 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3aa7c-fb19-4752-8646-0d0c4c96ac57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.542633 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3aa7c-fb19-4752-8646-0d0c4c96ac57 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.542916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3aa7c-fb19-4752-8646-0d0c4c96ac57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.543187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3aa7c-fb19-4752-8646-0d0c4c96ac57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.543914 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3aa7c-fb19-4752-8646-0d0c4c96ac57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:53.544219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3aa7c-fb19-4752-8646-0d0c4c96ac57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.545695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 277/570] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:53.545812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3aa7c-fb19-4752-8646-0d0c4c96ac57 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.546912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dab469-2f53-42c6-a3da-52a1899df72f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.557180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dab469-2f53-42c6-a3da-52a1899df72f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.562201 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462c16c-076a-41d5-bedb-0d28af68f2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.563233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462c16c-076a-41d5-bedb-0d28af68f2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.564249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462c16c-076a-41d5-bedb-0d28af68f2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.564692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462c16c-076a-41d5-bedb-0d28af68f2c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.572190 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462c16c-076a-41d5-bedb-0d28af68f2c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.574476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462c16c-076a-41d5-bedb-0d28af68f2c7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.576920 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 294/571] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:53.582511 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3aa7c-fb19-4752-8646-0d0c4c96ac57 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.589360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-5462c16c-076a-41d5-bedb-0d28af68f2c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:53.591006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 278/572] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:53.591981 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462c16c-076a-41d5-bedb-0d28af68f2c7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.592129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3aa7c-fb19-4752-8646-0d0c4c96ac57 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.597672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0606957-7ee0-434e-8251-b2d9b7cd396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.598442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0606957-7ee0-434e-8251-b2d9b7cd396a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.598731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0606957-7ee0-434e-8251-b2d9b7cd396a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.599007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0606957-7ee0-434e-8251-b2d9b7cd396a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.606709 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0606957-7ee0-434e-8251-b2d9b7cd396a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.608718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0606957-7ee0-434e-8251-b2d9b7cd396a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.609067 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462c16c-076a-41d5-bedb-0d28af68f2c7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.614411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac36c6-ac31-4333-8854-e8d2498d3b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.615499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac36c6-ac31-4333-8854-e8d2498d3b38 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.615932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac36c6-ac31-4333-8854-e8d2498d3b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.616395 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac36c6-ac31-4333-8854-e8d2498d3b38 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.624684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-a0606957-7ee0-434e-8251-b2d9b7cd396a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 09 00:56:53.625946 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 295/573] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/users/cinder => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:53.627751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0606957-7ee0-434e-8251-b2d9b7cd396a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.628848 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac36c6-ac31-4333-8854-e8d2498d3b38 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:53.636179 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-d8ac36c6-ac31-4333-8854-e8d2498d3b38 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:53.637529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 279/574] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:53.638033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0606957-7ee0-434e-8251-b2d9b7cd396a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.638635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac36c6-ac31-4333-8854-e8d2498d3b38 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.652693 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac36c6-ac31-4333-8854-e8d2498d3b38 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.654700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d2cce-5fc4-4833-ac8e-7b7de05700eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.655557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d2cce-5fc4-4833-ac8e-7b7de05700eb admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.655938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d2cce-5fc4-4833-ac8e-7b7de05700eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.656405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d2cce-5fc4-4833-ac8e-7b7de05700eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.658181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d2cce-5fc4-4833-ac8e-7b7de05700eb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:53.658900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d2cce-5fc4-4833-ac8e-7b7de05700eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.659508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911d336-b010-4d70-92cf-b78f611d0832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.660438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911d336-b010-4d70-92cf-b78f611d0832 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.660952 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911d336-b010-4d70-92cf-b78f611d0832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.661160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d2cce-5fc4-4833-ac8e-7b7de05700eb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.661519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911d336-b010-4d70-92cf-b78f611d0832 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.662600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911d336-b010-4d70-92cf-b78f611d0832 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:53.663074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911d336-b010-4d70-92cf-b78f611d0832 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.665213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911d336-b010-4d70-92cf-b78f611d0832 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.676214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 296/575] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:53.682110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d2cce-5fc4-4833-ac8e-7b7de05700eb admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.688239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d2cce-5fc4-4833-ac8e-7b7de05700eb admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.690876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 280/576] 10.222.0.23 () {56 vars in 1158 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:53.691699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911d336-b010-4d70-92cf-b78f611d0832 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.694871 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b5471-1296-4b91-a45a-1c1e8fe54546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.695822 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b5471-1296-4b91-a45a-1c1e8fe54546 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.696494 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b5471-1296-4b91-a45a-1c1e8fe54546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.697376 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b5471-1296-4b91-a45a-1c1e8fe54546 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.699102 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b5471-1296-4b91-a45a-1c1e8fe54546 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:53.699906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b5471-1296-4b91-a45a-1c1e8fe54546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.701708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911d336-b010-4d70-92cf-b78f611d0832 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.701823 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b5471-1296-4b91-a45a-1c1e8fe54546 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.706955 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76708f-b1a8-4ccd-89bd-c63fd6ee7afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.707886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76708f-b1a8-4ccd-89bd-c63fd6ee7afd admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.708214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76708f-b1a8-4ccd-89bd-c63fd6ee7afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.708491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76708f-b1a8-4ccd-89bd-c63fd6ee7afd admin admin] PATH_INFO: `/v3/projects/0566d367619740a48d8dca2def78a386/users/53d32ba063bc4a719d4c2f67d88ec640/roles/0de5bfc441494559af3a8cdd798c347e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.714275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 297/577] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:53.720519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b5471-1296-4b91-a45a-1c1e8fe54546 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.728304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76708f-b1a8-4ccd-89bd-c63fd6ee7afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566d367619740a48d8dca2def78a386, user_id=53d32ba063bc4a719d4c2f67d88ec640, role_id=0de5bfc441494559af3a8cdd798c347e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.731789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76708f-b1a8-4ccd-89bd-c63fd6ee7afd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.733413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b5471-1296-4b91-a45a-1c1e8fe54546 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.739679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cebf1-357d-42ae-8466-70ff4d627648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.740827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cebf1-357d-42ae-8466-70ff4d627648 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.741303 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cebf1-357d-42ae-8466-70ff4d627648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.741738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cebf1-357d-42ae-8466-70ff4d627648 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.747425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 281/578] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:53 2021] PUT /identity/v3/projects/0566d367619740a48d8dca2def78a386/users/53d32ba063bc4a719d4c2f67d88ec640/roles/0de5bfc441494559af3a8cdd798c347e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:53.751645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76708f-b1a8-4ccd-89bd-c63fd6ee7afd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.760393 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cebf1-357d-42ae-8466-70ff4d627648 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.762638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cebf1-357d-42ae-8466-70ff4d627648 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.798542 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-4f1cebf1-357d-42ae-8466-70ff4d627648 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:53.804465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 298/579] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:53.810429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cebf1-357d-42ae-8466-70ff4d627648 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.825649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cebf1-357d-42ae-8466-70ff4d627648 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.873719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76708f-b1a8-4ccd-89bd-c63fd6ee7afd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.884441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d538e-0cb6-443b-b0c3-4cceab5f5814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.885741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d538e-0cb6-443b-b0c3-4cceab5f5814 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.886032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d538e-0cb6-443b-b0c3-4cceab5f5814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.886311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d538e-0cb6-443b-b0c3-4cceab5f5814 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.900042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d538e-0cb6-443b-b0c3-4cceab5f5814 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.902569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d538e-0cb6-443b-b0c3-4cceab5f5814 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.931009 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-b33d538e-0cb6-443b-b0c3-4cceab5f5814 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:53.934002 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d11c9-f1ec-4920-accc-fc137abf981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.934716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d11c9-f1ec-4920-accc-fc137abf981e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.934999 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d11c9-f1ec-4920-accc-fc137abf981e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.935274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d11c9-f1ec-4920-accc-fc137abf981e admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.936091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d11c9-f1ec-4920-accc-fc137abf981e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:53.936450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d11c9-f1ec-4920-accc-fc137abf981e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.936610 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 282/580] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:53.938043 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d11c9-f1ec-4920-accc-fc137abf981e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.938386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e851193-c4ad-4bb3-8119-aa9c41ad92c1 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.938860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e851193-c4ad-4bb3-8119-aa9c41ad92c1 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.939334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e851193-c4ad-4bb3-8119-aa9c41ad92c1 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.945917 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 283/581] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:53.947149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e851193-c4ad-4bb3-8119-aa9c41ad92c1 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.951386 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 299/582] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:53.955274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8898f-e57e-4c81-aaeb-061ce4d5cfd0 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.955274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8898f-e57e-4c81-aaeb-061ce4d5cfd0 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.955274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8898f-e57e-4c81-aaeb-061ce4d5cfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.971075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e851193-c4ad-4bb3-8119-aa9c41ad92c1 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:53.975757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-94e8898f-e57e-4c81-aaeb-061ce4d5cfd0 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:53.976337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd7789-4691-4eb2-96ec-310c043ea24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:53.977183 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-94e8898f-e57e-4c81-aaeb-061ce4d5cfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:53.977444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd7789-4691-4eb2-96ec-310c043ea24a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:53.977909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd7789-4691-4eb2-96ec-310c043ea24a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:53.978535 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd7789-4691-4eb2-96ec-310c043ea24a admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:53.979530 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd7789-4691-4eb2-96ec-310c043ea24a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:53.980123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd7789-4691-4eb2-96ec-310c043ea24a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:53.982249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd7789-4691-4eb2-96ec-310c043ea24a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:53.994422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 300/583] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:53.994422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8898f-e57e-4c81-aaeb-061ce4d5cfd0 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:53.998964 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8898f-e57e-4c81-aaeb-061ce4d5cfd0 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.004810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 284/584] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:54.010840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd7789-4691-4eb2-96ec-310c043ea24a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.021689 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd7789-4691-4eb2-96ec-310c043ea24a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.022213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e40c5-2ab5-4f76-8b9f-63cc031dd132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.023072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e40c5-2ab5-4f76-8b9f-63cc031dd132 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.023361 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e40c5-2ab5-4f76-8b9f-63cc031dd132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.023640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e40c5-2ab5-4f76-8b9f-63cc031dd132 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.027114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b8a39-ec52-4ef3-b9a4-a2b2b5798641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.029175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b8a39-ec52-4ef3-b9a4-a2b2b5798641 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.029175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b8a39-ec52-4ef3-b9a4-a2b2b5798641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.029175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b8a39-ec52-4ef3-b9a4-a2b2b5798641 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.031297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e40c5-2ab5-4f76-8b9f-63cc031dd132 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.034136 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e40c5-2ab5-4f76-8b9f-63cc031dd132 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.039770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b8a39-ec52-4ef3-b9a4-a2b2b5798641 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.041777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b8a39-ec52-4ef3-b9a4-a2b2b5798641 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.051638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-9d6e40c5-2ab5-4f76-8b9f-63cc031dd132 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:54.053217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 301/585] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:54.054128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e40c5-2ab5-4f76-8b9f-63cc031dd132 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.058495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-ee9b8a39-ec52-4ef3-b9a4-a2b2b5798641 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 09 00:56:54.059870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 285/586] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:54.060649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b8a39-ec52-4ef3-b9a4-a2b2b5798641 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.065922 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e40c5-2ab5-4f76-8b9f-63cc031dd132 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.070889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009bc79-f8a3-4c84-aebd-e2cb70ef4594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.071894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009bc79-f8a3-4c84-aebd-e2cb70ef4594 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.072328 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009bc79-f8a3-4c84-aebd-e2cb70ef4594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.072758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009bc79-f8a3-4c84-aebd-e2cb70ef4594 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.075372 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b8a39-ec52-4ef3-b9a4-a2b2b5798641 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.081262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5a26f-f0c7-4aa5-843d-2a069fe5f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.081918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5a26f-f0c7-4aa5-843d-2a069fe5f6ee admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.082249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5a26f-f0c7-4aa5-843d-2a069fe5f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.082615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5a26f-f0c7-4aa5-843d-2a069fe5f6ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.083418 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5a26f-f0c7-4aa5-843d-2a069fe5f6ee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:54.083777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5a26f-f0c7-4aa5-843d-2a069fe5f6ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.085334 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009bc79-f8a3-4c84-aebd-e2cb70ef4594 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:54.085734 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5a26f-f0c7-4aa5-843d-2a069fe5f6ee admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.092638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-f009bc79-f8a3-4c84-aebd-e2cb70ef4594 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:54.094306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 302/587] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:54.095432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009bc79-f8a3-4c84-aebd-e2cb70ef4594 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.102591 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 286/588] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:54.104944 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5a26f-f0c7-4aa5-843d-2a069fe5f6ee admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.115217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009bc79-f8a3-4c84-aebd-e2cb70ef4594 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.117292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5a26f-f0c7-4aa5-843d-2a069fe5f6ee admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.122320 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf4a6f-7971-46c5-8e4d-1c119a80d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.123046 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca123fa-1641-4d19-82c8-bfb9d93fca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.123329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf4a6f-7971-46c5-8e4d-1c119a80d4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.123684 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf4a6f-7971-46c5-8e4d-1c119a80d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.124030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf4a6f-7971-46c5-8e4d-1c119a80d4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.124908 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf4a6f-7971-46c5-8e4d-1c119a80d4c3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:54.125149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca123fa-1641-4d19-82c8-bfb9d93fca82 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.125348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf4a6f-7971-46c5-8e4d-1c119a80d4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.125995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca123fa-1641-4d19-82c8-bfb9d93fca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.127257 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca123fa-1641-4d19-82c8-bfb9d93fca82 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.128139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf4a6f-7971-46c5-8e4d-1c119a80d4c3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.129210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca123fa-1641-4d19-82c8-bfb9d93fca82 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:54.129944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca123fa-1641-4d19-82c8-bfb9d93fca82 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.133611 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca123fa-1641-4d19-82c8-bfb9d93fca82 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.137393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 287/589] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:54.138277 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf4a6f-7971-46c5-8e4d-1c119a80d4c3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.148777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf4a6f-7971-46c5-8e4d-1c119a80d4c3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.153496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62227d93-6162-4e09-b68e-b02a4f08bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.154558 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62227d93-6162-4e09-b68e-b02a4f08bd87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.154915 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62227d93-6162-4e09-b68e-b02a4f08bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.155302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62227d93-6162-4e09-b68e-b02a4f08bd87 admin admin] PATH_INFO: `/v3/projects/0566d367619740a48d8dca2def78a386/users/fb5625c813724729bb927c201f23e417/roles/0de5bfc441494559af3a8cdd798c347e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.170987 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 303/590] 10.222.0.23 () {56 vars in 1160 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:54.172186 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca123fa-1641-4d19-82c8-bfb9d93fca82 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.175300 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62227d93-6162-4e09-b68e-b02a4f08bd87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566d367619740a48d8dca2def78a386, user_id=fb5625c813724729bb927c201f23e417, role_id=0de5bfc441494559af3a8cdd798c347e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.178073 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62227d93-6162-4e09-b68e-b02a4f08bd87 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.183710 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca123fa-1641-4d19-82c8-bfb9d93fca82 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.192029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e7386-bdd9-4ace-8f87-d305348559cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.192822 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e7386-bdd9-4ace-8f87-d305348559cf admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.193103 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e7386-bdd9-4ace-8f87-d305348559cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.193376 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e7386-bdd9-4ace-8f87-d305348559cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.199913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 288/591] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:54 2021] PUT /identity/v3/projects/0566d367619740a48d8dca2def78a386/users/fb5625c813724729bb927c201f23e417/roles/0de5bfc441494559af3a8cdd798c347e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:54.200542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62227d93-6162-4e09-b68e-b02a4f08bd87 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.227382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e7386-bdd9-4ace-8f87-d305348559cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.229348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e7386-bdd9-4ace-8f87-d305348559cf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.262156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-d66e7386-bdd9-4ace-8f87-d305348559cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:54.271608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 304/592] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:54.277539 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62227d93-6162-4e09-b68e-b02a4f08bd87 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.277764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e7386-bdd9-4ace-8f87-d305348559cf admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.283287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a250d-817f-4c24-b645-6ed1b29a1c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.284417 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a250d-817f-4c24-b645-6ed1b29a1c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.284926 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a250d-817f-4c24-b645-6ed1b29a1c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.285388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a250d-817f-4c24-b645-6ed1b29a1c96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.297156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e7386-bdd9-4ace-8f87-d305348559cf admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.300317 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a250d-817f-4c24-b645-6ed1b29a1c96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.303419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a250d-817f-4c24-b645-6ed1b29a1c96 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.315714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91423945-2ace-4bf2-81ab-5f42c8b65edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.316304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91423945-2ace-4bf2-81ab-5f42c8b65edf admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.316586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91423945-2ace-4bf2-81ab-5f42c8b65edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.316862 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91423945-2ace-4bf2-81ab-5f42c8b65edf admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.317602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91423945-2ace-4bf2-81ab-5f42c8b65edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:54.317952 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91423945-2ace-4bf2-81ab-5f42c8b65edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.319522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91423945-2ace-4bf2-81ab-5f42c8b65edf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.326465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-2a0a250d-817f-4c24-b645-6ed1b29a1c96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:54.328703 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 289/593] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:54.335859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a250d-817f-4c24-b645-6ed1b29a1c96 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.345935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 305/594] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:54.355228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a250d-817f-4c24-b645-6ed1b29a1c96 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.356811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91423945-2ace-4bf2-81ab-5f42c8b65edf admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.369007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91423945-2ace-4bf2-81ab-5f42c8b65edf admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.371785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9491c-7022-464d-9d96-ca25d0a0dd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.372463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9491c-7022-464d-9d96-ca25d0a0dd4f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.372751 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9491c-7022-464d-9d96-ca25d0a0dd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.373028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9491c-7022-464d-9d96-ca25d0a0dd4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.373780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9491c-7022-464d-9d96-ca25d0a0dd4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:54.374087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9491c-7022-464d-9d96-ca25d0a0dd4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.376835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9491c-7022-464d-9d96-ca25d0a0dd4f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.386673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea52cbf-644e-4d3f-9d8d-c8e0f154df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.387487 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea52cbf-644e-4d3f-9d8d-c8e0f154df71 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.387768 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea52cbf-644e-4d3f-9d8d-c8e0f154df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.388042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea52cbf-644e-4d3f-9d8d-c8e0f154df71 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.399087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea52cbf-644e-4d3f-9d8d-c8e0f154df71 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.401150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea52cbf-644e-4d3f-9d8d-c8e0f154df71 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.403878 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 290/595] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:54.410675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9491c-7022-464d-9d96-ca25d0a0dd4f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.429180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9491c-7022-464d-9d96-ca25d0a0dd4f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.432904 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-6ea52cbf-644e-4d3f-9d8d-c8e0f154df71 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 09 00:56:54.437133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 306/596] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/users/swift => generated 83 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:54.441601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea52cbf-644e-4d3f-9d8d-c8e0f154df71 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.447937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf9690-7962-4faa-b84d-7d0df939533a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.448752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf9690-7962-4faa-b84d-7d0df939533a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.449040 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf9690-7962-4faa-b84d-7d0df939533a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.449315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf9690-7962-4faa-b84d-7d0df939533a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.452316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea52cbf-644e-4d3f-9d8d-c8e0f154df71 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.459741 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43419c-9a5c-44d2-82e8-908d6803944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.460639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43419c-9a5c-44d2-82e8-908d6803944d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.461098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43419c-9a5c-44d2-82e8-908d6803944d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.461545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43419c-9a5c-44d2-82e8-908d6803944d admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.462578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43419c-9a5c-44d2-82e8-908d6803944d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:54.463068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43419c-9a5c-44d2-82e8-908d6803944d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.463415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf9690-7962-4faa-b84d-7d0df939533a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.465286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43419c-9a5c-44d2-82e8-908d6803944d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.465559 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf9690-7962-4faa-b84d-7d0df939533a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.482493 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-0caf9690-7962-4faa-b84d-7d0df939533a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:54.482493 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 291/597] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:54.489143 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf9690-7962-4faa-b84d-7d0df939533a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.500940 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 307/598] 10.222.0.23 () {56 vars in 1156 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:54.504197 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf9690-7962-4faa-b84d-7d0df939533a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.508350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43419c-9a5c-44d2-82e8-908d6803944d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.510842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71281d-d336-4a59-bd9a-65ddbd73a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.511596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71281d-d336-4a59-bd9a-65ddbd73a243 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.511975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71281d-d336-4a59-bd9a-65ddbd73a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.512346 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71281d-d336-4a59-bd9a-65ddbd73a243 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.513237 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71281d-d336-4a59-bd9a-65ddbd73a243 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:54.513641 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71281d-d336-4a59-bd9a-65ddbd73a243 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.515652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71281d-d336-4a59-bd9a-65ddbd73a243 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.521193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43419c-9a5c-44d2-82e8-908d6803944d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.525884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea412086-6511-4083-b809-574647ae3d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.526756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412086-6511-4083-b809-574647ae3d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.527190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412086-6511-4083-b809-574647ae3d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.527612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412086-6511-4083-b809-574647ae3d62 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.529445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 292/599] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:54.537165 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71281d-d336-4a59-bd9a-65ddbd73a243 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.538455 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea412086-6511-4083-b809-574647ae3d62 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.540369 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea412086-6511-4083-b809-574647ae3d62 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.551098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71281d-d336-4a59-bd9a-65ddbd73a243 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.553685 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 308/600] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:54.560006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea412086-6511-4083-b809-574647ae3d62 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.560250 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951e30a-2909-417c-854b-36489b774386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.561310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951e30a-2909-417c-854b-36489b774386 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.561761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951e30a-2909-417c-854b-36489b774386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.562132 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951e30a-2909-417c-854b-36489b774386 admin admin] PATH_INFO: `/v3/projects/0566d367619740a48d8dca2def78a386/users/0ab73b6f3a1949359549f91e1b708600/roles/0de5bfc441494559af3a8cdd798c347e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.570587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea412086-6511-4083-b809-574647ae3d62 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.575775 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ef24e-bfdf-4f23-a5d3-3bcf46ef8007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.576826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ef24e-bfdf-4f23-a5d3-3bcf46ef8007 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.577302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ef24e-bfdf-4f23-a5d3-3bcf46ef8007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.577726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ef24e-bfdf-4f23-a5d3-3bcf46ef8007 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.580624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951e30a-2909-417c-854b-36489b774386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566d367619740a48d8dca2def78a386, user_id=0ab73b6f3a1949359549f91e1b708600, role_id=0de5bfc441494559af3a8cdd798c347e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.583402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951e30a-2909-417c-854b-36489b774386 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.590222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ef24e-bfdf-4f23-a5d3-3bcf46ef8007 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.592127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ef24e-bfdf-4f23-a5d3-3bcf46ef8007 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.601282 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 293/601] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:54 2021] PUT /identity/v3/projects/0566d367619740a48d8dca2def78a386/users/0ab73b6f3a1949359549f91e1b708600/roles/0de5bfc441494559af3a8cdd798c347e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:54.616094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-459ef24e-bfdf-4f23-a5d3-3bcf46ef8007 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:54.617785 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 309/602] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:54.624265 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951e30a-2909-417c-854b-36489b774386 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.695616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951e30a-2909-417c-854b-36489b774386 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.700713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d785258-16d6-4d9b-a56c-35b08b1cb1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.701582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d785258-16d6-4d9b-a56c-35b08b1cb1bd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.702049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d785258-16d6-4d9b-a56c-35b08b1cb1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.702520 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d785258-16d6-4d9b-a56c-35b08b1cb1bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.703415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d785258-16d6-4d9b-a56c-35b08b1cb1bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:54.703865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d785258-16d6-4d9b-a56c-35b08b1cb1bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.706740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d785258-16d6-4d9b-a56c-35b08b1cb1bd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.720098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 294/603] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:54.725960 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ef24e-bfdf-4f23-a5d3-3bcf46ef8007 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.749339 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ef24e-bfdf-4f23-a5d3-3bcf46ef8007 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.760294 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3aa27-e77a-4fab-b2ef-e4ec3ac62956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.761120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3aa27-e77a-4fab-b2ef-e4ec3ac62956 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.761401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3aa27-e77a-4fab-b2ef-e4ec3ac62956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.761687 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3aa27-e77a-4fab-b2ef-e4ec3ac62956 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.776174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3aa27-e77a-4fab-b2ef-e4ec3ac62956 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.778149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3aa27-e77a-4fab-b2ef-e4ec3ac62956 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.796506 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-fca3aa27-e77a-4fab-b2ef-e4ec3ac62956 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:54.802600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 310/604] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:54.805055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d785258-16d6-4d9b-a56c-35b08b1cb1bd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.820573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d785258-16d6-4d9b-a56c-35b08b1cb1bd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.826826 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da260f-d88b-433f-9fbe-26545774d816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.827875 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da260f-d88b-433f-9fbe-26545774d816 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.828312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da260f-d88b-433f-9fbe-26545774d816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.828740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da260f-d88b-433f-9fbe-26545774d816 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.830346 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da260f-d88b-433f-9fbe-26545774d816 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:54.830870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da260f-d88b-433f-9fbe-26545774d816 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.833041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da260f-d88b-433f-9fbe-26545774d816 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.858862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 295/605] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:54.867490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3aa27-e77a-4fab-b2ef-e4ec3ac62956 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:54.879668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3aa27-e77a-4fab-b2ef-e4ec3ac62956 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:54.890645 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d396a27-7a20-4c8c-8628-42bcb5c62e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:54.891740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d396a27-7a20-4c8c-8628-42bcb5c62e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:54.892019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d396a27-7a20-4c8c-8628-42bcb5c62e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:54.892340 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d396a27-7a20-4c8c-8628-42bcb5c62e99 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:54.893201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d396a27-7a20-4c8c-8628-42bcb5c62e99 admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=f2a17190105a4228bdd94926e1a2091e) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:54.893509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d396a27-7a20-4c8c-8628-42bcb5c62e99 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:54.895521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d396a27-7a20-4c8c-8628-42bcb5c62e99 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:54.904374 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 311/606] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:54 2021] GET /identity/v3/role_assignments?user.id=f2a17190105a4228bdd94926e1a2091e&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:56.089387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b48cd-9336-408b-bcf1-8ce37aee0121 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.089925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b48cd-9336-408b-bcf1-8ce37aee0121 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.089925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b48cd-9336-408b-bcf1-8ce37aee0121 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.092014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 296/607] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:56.103751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e410-18eb-4eeb-a822-680182a36109 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.104234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e410-18eb-4eeb-a822-680182a36109 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.104234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e410-18eb-4eeb-a822-680182a36109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.122686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-fa23e410-18eb-4eeb-a822-680182a36109 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:56.123895 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fa23e410-18eb-4eeb-a822-680182a36109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:56.136746 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 312/608] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:56.161340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b48cd-9336-408b-bcf1-8ce37aee0121 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.178178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b48cd-9336-408b-bcf1-8ce37aee0121 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.184400 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c6f6d-8b84-48a6-8944-9c2a31670ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.185219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c6f6d-8b84-48a6-8944-9c2a31670ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.185503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c6f6d-8b84-48a6-8944-9c2a31670ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.185780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c6f6d-8b84-48a6-8944-9c2a31670ef5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.198448 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c6f6d-8b84-48a6-8944-9c2a31670ef5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:56.206314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-e92c6f6d-8b84-48a6-8944-9c2a31670ef5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:56.207797 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 297/609] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:56.214032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23e410-18eb-4eeb-a822-680182a36109 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.223754 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23e410-18eb-4eeb-a822-680182a36109 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.228533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0af635-da5f-44cd-a8bf-f2a83ad6b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.229225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0af635-da5f-44cd-a8bf-f2a83ad6b686 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.229506 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0af635-da5f-44cd-a8bf-f2a83ad6b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.229783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0af635-da5f-44cd-a8bf-f2a83ad6b686 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.230600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0af635-da5f-44cd-a8bf-f2a83ad6b686 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:56.230911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0af635-da5f-44cd-a8bf-f2a83ad6b686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:56.232547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0af635-da5f-44cd-a8bf-f2a83ad6b686 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:56.243295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 313/610] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:56.249325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c6f6d-8b84-48a6-8944-9c2a31670ef5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.259218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c6f6d-8b84-48a6-8944-9c2a31670ef5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.263687 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd918311-ee9b-42e3-b2a6-16d00756324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.264461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd918311-ee9b-42e3-b2a6-16d00756324f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.264739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd918311-ee9b-42e3-b2a6-16d00756324f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.265013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd918311-ee9b-42e3-b2a6-16d00756324f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.276299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd918311-ee9b-42e3-b2a6-16d00756324f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:56.278133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd918311-ee9b-42e3-b2a6-16d00756324f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:56.294608 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-cd918311-ee9b-42e3-b2a6-16d00756324f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:56.296136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 298/611] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:56.302673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0af635-da5f-44cd-a8bf-f2a83ad6b686 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.312680 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0af635-da5f-44cd-a8bf-f2a83ad6b686 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.317348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b4188-582f-4593-bb34-537511059e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.318054 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b4188-582f-4593-bb34-537511059e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.318343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b4188-582f-4593-bb34-537511059e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.318642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b4188-582f-4593-bb34-537511059e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.320526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b4188-582f-4593-bb34-537511059e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:56.320526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b4188-582f-4593-bb34-537511059e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:56.321308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b4188-582f-4593-bb34-537511059e16 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:56.334313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 314/612] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:56.340159 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd918311-ee9b-42e3-b2a6-16d00756324f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.350347 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd918311-ee9b-42e3-b2a6-16d00756324f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.354945 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8806e34-404b-4b6a-9a2c-b3264e13dfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.355767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8806e34-404b-4b6a-9a2c-b3264e13dfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.356068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8806e34-404b-4b6a-9a2c-b3264e13dfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.356313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8806e34-404b-4b6a-9a2c-b3264e13dfe4 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.366918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8806e34-404b-4b6a-9a2c-b3264e13dfe4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:56.368934 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8806e34-404b-4b6a-9a2c-b3264e13dfe4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:56.383989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-f8806e34-404b-4b6a-9a2c-b3264e13dfe4 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 09 00:56:56.385497 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 299/613] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/users/glance => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:56.392255 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b4188-582f-4593-bb34-537511059e16 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.402299 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b4188-582f-4593-bb34-537511059e16 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.406944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969181dc-aedc-4b28-820f-34de36fecc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.407912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969181dc-aedc-4b28-820f-34de36fecc54 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.408197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969181dc-aedc-4b28-820f-34de36fecc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.408472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969181dc-aedc-4b28-820f-34de36fecc54 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.409339 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969181dc-aedc-4b28-820f-34de36fecc54 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:56.409652 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969181dc-aedc-4b28-820f-34de36fecc54 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:56.411535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969181dc-aedc-4b28-820f-34de36fecc54 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:56.430015 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 315/614] 10.222.0.23 () {56 vars in 1158 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:56.435869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8806e34-404b-4b6a-9a2c-b3264e13dfe4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.446272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8806e34-404b-4b6a-9a2c-b3264e13dfe4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.450936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8ef53-1058-43af-907c-2af0971a74c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.451574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8ef53-1058-43af-907c-2af0971a74c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.451909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8ef53-1058-43af-907c-2af0971a74c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.452187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8ef53-1058-43af-907c-2af0971a74c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.461140 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8ef53-1058-43af-907c-2af0971a74c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:56.463028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8ef53-1058-43af-907c-2af0971a74c5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:56.473159 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 300/615] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:56.479069 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969181dc-aedc-4b28-820f-34de36fecc54 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.489628 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969181dc-aedc-4b28-820f-34de36fecc54 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.494264 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708219b2-613a-4c6c-b798-9522d5616e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.495074 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708219b2-613a-4c6c-b798-9522d5616e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.495401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708219b2-613a-4c6c-b798-9522d5616e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.495670 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708219b2-613a-4c6c-b798-9522d5616e34 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.507371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708219b2-613a-4c6c-b798-9522d5616e34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:56.509191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708219b2-613a-4c6c-b798-9522d5616e34 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:56.526577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-708219b2-613a-4c6c-b798-9522d5616e34 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:56.528103 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 316/616] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:56.534754 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8ef53-1058-43af-907c-2af0971a74c5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.543753 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8ef53-1058-43af-907c-2af0971a74c5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.549021 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab932cb1-8e2b-41a8-a6f4-8982458723e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.549724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab932cb1-8e2b-41a8-a6f4-8982458723e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.550008 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab932cb1-8e2b-41a8-a6f4-8982458723e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.550279 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab932cb1-8e2b-41a8-a6f4-8982458723e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.551087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab932cb1-8e2b-41a8-a6f4-8982458723e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:56.551391 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab932cb1-8e2b-41a8-a6f4-8982458723e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:56.553008 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab932cb1-8e2b-41a8-a6f4-8982458723e4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:56.565586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 301/617] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:56.571395 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708219b2-613a-4c6c-b798-9522d5616e34 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.581645 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708219b2-613a-4c6c-b798-9522d5616e34 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.586431 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb8580-85ab-480c-aff8-8a69782bc671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.587269 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8580-85ab-480c-aff8-8a69782bc671 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.587550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8580-85ab-480c-aff8-8a69782bc671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.587826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8580-85ab-480c-aff8-8a69782bc671 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.595942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb8580-85ab-480c-aff8-8a69782bc671 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:56.597957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb8580-85ab-480c-aff8-8a69782bc671 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:56.612071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-80cb8580-85ab-480c-aff8-8a69782bc671 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:56.613506 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 317/618] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:56.619701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab932cb1-8e2b-41a8-a6f4-8982458723e4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.630308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab932cb1-8e2b-41a8-a6f4-8982458723e4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.636633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28225a33-e7ad-4273-8ee8-3dc88ad7daf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.637313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28225a33-e7ad-4273-8ee8-3dc88ad7daf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.637600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28225a33-e7ad-4273-8ee8-3dc88ad7daf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.637872 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28225a33-e7ad-4273-8ee8-3dc88ad7daf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.638798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28225a33-e7ad-4273-8ee8-3dc88ad7daf2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:56.639100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28225a33-e7ad-4273-8ee8-3dc88ad7daf2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:56.641052 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28225a33-e7ad-4273-8ee8-3dc88ad7daf2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:56.658404 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 302/619] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:56.664726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb8580-85ab-480c-aff8-8a69782bc671 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.676098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb8580-85ab-480c-aff8-8a69782bc671 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.686610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9bc11-f8b8-4b62-b2de-c3424a289d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.687257 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9bc11-f8b8-4b62-b2de-c3424a289d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.687587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9bc11-f8b8-4b62-b2de-c3424a289d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.687862 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9bc11-f8b8-4b62-b2de-c3424a289d7f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.689521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9bc11-f8b8-4b62-b2de-c3424a289d7f admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=3d001733477f499e937ba90e7e50ba33) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:56.689883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9bc11-f8b8-4b62-b2de-c3424a289d7f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:56.691813 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9bc11-f8b8-4b62-b2de-c3424a289d7f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:56.702736 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 318/620] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/role_assignments?user.id=3d001733477f499e937ba90e7e50ba33&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:56.814390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933fe95-e1da-46cc-abaf-11146b667407 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.814390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933fe95-e1da-46cc-abaf-11146b667407 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.814390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933fe95-e1da-46cc-abaf-11146b667407 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.814390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 303/621] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:56.821200 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9849634-fcca-466f-b720-660d938875a0 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.821492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9849634-fcca-466f-b720-660d938875a0 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.821774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9849634-fcca-466f-b720-660d938875a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.849410 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e9849634-fcca-466f-b720-660d938875a0 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:56.850695 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e9849634-fcca-466f-b720-660d938875a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:56.865140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 319/622] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:56.901035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933fe95-e1da-46cc-abaf-11146b667407 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.920025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933fe95-e1da-46cc-abaf-11146b667407 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.927936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83c63e-d452-486f-a473-c1e649380855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.929119 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83c63e-d452-486f-a473-c1e649380855 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.929596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83c63e-d452-486f-a473-c1e649380855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.930064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83c63e-d452-486f-a473-c1e649380855 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.944298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83c63e-d452-486f-a473-c1e649380855 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:56.951836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-ca83c63e-d452-486f-a473-c1e649380855 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:56.953755 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 304/623] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:56.960419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9849634-fcca-466f-b720-660d938875a0 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:56.970648 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9849634-fcca-466f-b720-660d938875a0 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:56.975225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddb079-5e52-4e25-a2a6-9774a73d04d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:56.975894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddb079-5e52-4e25-a2a6-9774a73d04d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:56.976178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddb079-5e52-4e25-a2a6-9774a73d04d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:56.976457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddb079-5e52-4e25-a2a6-9774a73d04d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:56.977212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddb079-5e52-4e25-a2a6-9774a73d04d3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:56.977519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddb079-5e52-4e25-a2a6-9774a73d04d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:56.979145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddb079-5e52-4e25-a2a6-9774a73d04d3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:56.988783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 320/624] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:56.994618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83c63e-d452-486f-a473-c1e649380855 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.005982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83c63e-d452-486f-a473-c1e649380855 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.011387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976f3f7-33f9-40f7-bcf8-77481d2af893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.012388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f3f7-33f9-40f7-bcf8-77481d2af893 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.012867 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f3f7-33f9-40f7-bcf8-77481d2af893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.013344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f3f7-33f9-40f7-bcf8-77481d2af893 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.025569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976f3f7-33f9-40f7-bcf8-77481d2af893 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.027739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976f3f7-33f9-40f7-bcf8-77481d2af893 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.048964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-1976f3f7-33f9-40f7-bcf8-77481d2af893 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:57.050784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 305/625] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:57.056539 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddb079-5e52-4e25-a2a6-9774a73d04d3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.067186 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddb079-5e52-4e25-a2a6-9774a73d04d3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.072099 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3283bc-364f-4b7a-a057-33d5bff6299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.072975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3283bc-364f-4b7a-a057-33d5bff6299d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.073480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3283bc-364f-4b7a-a057-33d5bff6299d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.073943 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3283bc-364f-4b7a-a057-33d5bff6299d admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.074934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3283bc-364f-4b7a-a057-33d5bff6299d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:57.075499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3283bc-364f-4b7a-a057-33d5bff6299d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.077358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3283bc-364f-4b7a-a057-33d5bff6299d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.098161 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 321/626] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:57.104095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976f3f7-33f9-40f7-bcf8-77481d2af893 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.120970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976f3f7-33f9-40f7-bcf8-77481d2af893 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.130494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b1557-065d-4652-a264-86cbc6790459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.131463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b1557-065d-4652-a264-86cbc6790459 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.131883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b1557-065d-4652-a264-86cbc6790459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.132293 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b1557-065d-4652-a264-86cbc6790459 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.140215 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b1557-065d-4652-a264-86cbc6790459 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.143294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b1557-065d-4652-a264-86cbc6790459 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.157625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-a39b1557-065d-4652-a264-86cbc6790459 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 09 00:56:57.159555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 306/627] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:57.165246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3283bc-364f-4b7a-a057-33d5bff6299d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.179689 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3283bc-364f-4b7a-a057-33d5bff6299d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.188278 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4649d2-77bd-4df3-97b0-a18ebebce33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.189675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4649d2-77bd-4df3-97b0-a18ebebce33e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.189957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4649d2-77bd-4df3-97b0-a18ebebce33e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.190330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4649d2-77bd-4df3-97b0-a18ebebce33e admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.191321 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4649d2-77bd-4df3-97b0-a18ebebce33e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:57.191638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4649d2-77bd-4df3-97b0-a18ebebce33e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.193539 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4649d2-77bd-4df3-97b0-a18ebebce33e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.213310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 322/628] 10.222.0.23 () {56 vars in 1154 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:57.219344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b1557-065d-4652-a264-86cbc6790459 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.230511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b1557-065d-4652-a264-86cbc6790459 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.235624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45df45-8833-4ac5-8662-a54d9ad9f61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.236294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45df45-8833-4ac5-8662-a54d9ad9f61c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.236631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45df45-8833-4ac5-8662-a54d9ad9f61c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.237164 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45df45-8833-4ac5-8662-a54d9ad9f61c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.246611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45df45-8833-4ac5-8662-a54d9ad9f61c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.248545 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45df45-8833-4ac5-8662-a54d9ad9f61c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.264768 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 307/629] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:57.265981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4649d2-77bd-4df3-97b0-a18ebebce33e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.285110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4649d2-77bd-4df3-97b0-a18ebebce33e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.294036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b0a9d-793b-432e-aced-c1d7c6a59881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.295062 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0a9d-793b-432e-aced-c1d7c6a59881 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.295484 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0a9d-793b-432e-aced-c1d7c6a59881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.295895 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0a9d-793b-432e-aced-c1d7c6a59881 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.318077 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b0a9d-793b-432e-aced-c1d7c6a59881 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.320191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b0a9d-793b-432e-aced-c1d7c6a59881 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.349641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-c87b0a9d-793b-432e-aced-c1d7c6a59881 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:57.351521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 323/630] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:57.357458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45df45-8833-4ac5-8662-a54d9ad9f61c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.372190 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45df45-8833-4ac5-8662-a54d9ad9f61c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.382228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295869e6-713a-4a44-a814-7dd3cbc1584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.382979 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295869e6-713a-4a44-a814-7dd3cbc1584f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.383262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295869e6-713a-4a44-a814-7dd3cbc1584f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.383537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295869e6-713a-4a44-a814-7dd3cbc1584f admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.384289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295869e6-713a-4a44-a814-7dd3cbc1584f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:57.384595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295869e6-713a-4a44-a814-7dd3cbc1584f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.386185 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295869e6-713a-4a44-a814-7dd3cbc1584f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.402953 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 308/631] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:57.409479 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b0a9d-793b-432e-aced-c1d7c6a59881 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.423787 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b0a9d-793b-432e-aced-c1d7c6a59881 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.434046 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e1b6-1292-40e3-9232-30853dacf7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.435027 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e1b6-1292-40e3-9232-30853dacf7ef admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.435458 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e1b6-1292-40e3-9232-30853dacf7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.435867 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e1b6-1292-40e3-9232-30853dacf7ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.449899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e1b6-1292-40e3-9232-30853dacf7ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.452107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e1b6-1292-40e3-9232-30853dacf7ef admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.473022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-8748e1b6-1292-40e3-9232-30853dacf7ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:57.474483 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 324/632] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:57.480767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295869e6-713a-4a44-a814-7dd3cbc1584f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.490456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50a6bc-9b01-42ca-a7f0-0a5ffbb48492 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.490954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50a6bc-9b01-42ca-a7f0-0a5ffbb48492 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.491367 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50a6bc-9b01-42ca-a7f0-0a5ffbb48492 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.493526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 325/633] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:56:57.500181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cee63-7ba1-4eac-8e08-832d53bc59f8 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.500625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cee63-7ba1-4eac-8e08-832d53bc59f8 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.501565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cee63-7ba1-4eac-8e08-832d53bc59f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.502357 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295869e6-713a-4a44-a814-7dd3cbc1584f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.513969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce140a8c-09fb-4e41-8ddb-1da4912684dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.514834 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce140a8c-09fb-4e41-8ddb-1da4912684dd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.515256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce140a8c-09fb-4e41-8ddb-1da4912684dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.515667 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce140a8c-09fb-4e41-8ddb-1da4912684dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.520959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce140a8c-09fb-4e41-8ddb-1da4912684dd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:57.521451 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce140a8c-09fb-4e41-8ddb-1da4912684dd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.523491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce140a8c-09fb-4e41-8ddb-1da4912684dd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.539065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-b48cee63-7ba1-4eac-8e08-832d53bc59f8 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:57.540474 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b48cee63-7ba1-4eac-8e08-832d53bc59f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:57.546144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 309/634] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:57.553817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce140a8c-09fb-4e41-8ddb-1da4912684dd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.557414 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 326/635] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:57.573810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce140a8c-09fb-4e41-8ddb-1da4912684dd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.587850 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ff63a-841b-4b6d-8948-4a51f1f17d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.588667 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ff63a-841b-4b6d-8948-4a51f1f17d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.589111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ff63a-841b-4b6d-8948-4a51f1f17d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.589519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ff63a-841b-4b6d-8948-4a51f1f17d81 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.590516 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ff63a-841b-4b6d-8948-4a51f1f17d81 admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=53d32ba063bc4a719d4c2f67d88ec640) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:57.590963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ff63a-841b-4b6d-8948-4a51f1f17d81 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.592924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ff63a-841b-4b6d-8948-4a51f1f17d81 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.602960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 310/636] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/role_assignments?user.id=53d32ba063bc4a719d4c2f67d88ec640&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:57.606745 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cee63-7ba1-4eac-8e08-832d53bc59f8 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.625091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cee63-7ba1-4eac-8e08-832d53bc59f8 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.632094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcc7b0-508a-4767-8fd1-0c9adeb21995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.632902 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc7b0-508a-4767-8fd1-0c9adeb21995 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.633233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc7b0-508a-4767-8fd1-0c9adeb21995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.633558 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc7b0-508a-4767-8fd1-0c9adeb21995 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.652610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcc7b0-508a-4767-8fd1-0c9adeb21995 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:57.660070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-53fcc7b0-508a-4767-8fd1-0c9adeb21995 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:57.661730 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 327/637] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:57.667999 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcc7b0-508a-4767-8fd1-0c9adeb21995 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.668889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbabeb-6cbc-4e92-9524-2e96f94c52b2 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.669317 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbabeb-6cbc-4e92-9524-2e96f94c52b2 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.669729 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbabeb-6cbc-4e92-9524-2e96f94c52b2 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.671882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 311/638] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:57.678049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7a9d0-6af3-433a-ad87-993df7eeb50d None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.678551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7a9d0-6af3-433a-ad87-993df7eeb50d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.678965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7a9d0-6af3-433a-ad87-993df7eeb50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.679076 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcc7b0-508a-4767-8fd1-0c9adeb21995 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.688786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c86bbb-311b-424e-84af-b16e464a058b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.689795 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c86bbb-311b-424e-84af-b16e464a058b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.691143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c86bbb-311b-424e-84af-b16e464a058b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.691983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c86bbb-311b-424e-84af-b16e464a058b admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.693479 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c86bbb-311b-424e-84af-b16e464a058b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:57.693951 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c86bbb-311b-424e-84af-b16e464a058b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.698319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c86bbb-311b-424e-84af-b16e464a058b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.713576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-6bc7a9d0-6af3-433a-ad87-993df7eeb50d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:57.716240 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-6bc7a9d0-6af3-433a-ad87-993df7eeb50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:57.719211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 328/639] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:57.727176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c86bbb-311b-424e-84af-b16e464a058b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.742704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 312/640] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:56:57.745422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c86bbb-311b-424e-84af-b16e464a058b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.750264 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80c031-e1c7-4ee2-85a8-2d0b25b755a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.751358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80c031-e1c7-4ee2-85a8-2d0b25b755a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.751898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80c031-e1c7-4ee2-85a8-2d0b25b755a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.752332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80c031-e1c7-4ee2-85a8-2d0b25b755a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.764124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80c031-e1c7-4ee2-85a8-2d0b25b755a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.766331 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80c031-e1c7-4ee2-85a8-2d0b25b755a0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.780329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7a9d0-6af3-433a-ad87-993df7eeb50d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.790486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7a9d0-6af3-433a-ad87-993df7eeb50d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.800858 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be989cb-9080-4e07-a494-d3160b74e1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.801958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be989cb-9080-4e07-a494-d3160b74e1cf admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.802137 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-4f80c031-e1c7-4ee2-85a8-2d0b25b755a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:57.802601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be989cb-9080-4e07-a494-d3160b74e1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.803069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be989cb-9080-4e07-a494-d3160b74e1cf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.803781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 329/641] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:57.805201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287af8-feae-485c-9866-d353cb945310 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.805602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287af8-feae-485c-9866-d353cb945310 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.810521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287af8-feae-485c-9866-d353cb945310 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.810521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 330/642] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:57.813715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287af8-feae-485c-9866-d353cb945310 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.823609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be989cb-9080-4e07-a494-d3160b74e1cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:57.827447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287af8-feae-485c-9866-d353cb945310 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.833113 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-0be989cb-9080-4e07-a494-d3160b74e1cf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:57.838880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 313/643] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:57.838880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3415-4065-4f92-8554-2a56b257c727 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.838880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3415-4065-4f92-8554-2a56b257c727 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.838880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3415-4065-4f92-8554-2a56b257c727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.843447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dd87a-78ab-44bc-b875-d43254c0c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.844115 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd87a-78ab-44bc-b875-d43254c0c199 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.844390 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd87a-78ab-44bc-b875-d43254c0c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.844696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd87a-78ab-44bc-b875-d43254c0c199 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.845546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dd87a-78ab-44bc-b875-d43254c0c199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:57.845850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dd87a-78ab-44bc-b875-d43254c0c199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.847523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dd87a-78ab-44bc-b875-d43254c0c199 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.869939 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 331/644] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:57.869939 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dd87a-78ab-44bc-b875-d43254c0c199 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.871243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-02bd3415-4065-4f92-8554-2a56b257c727 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:57.872625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-02bd3415-4065-4f92-8554-2a56b257c727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:57.881310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dd87a-78ab-44bc-b875-d43254c0c199 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.890405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d21a-84db-441e-8be5-ecdcc8c6f683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.890405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d21a-84db-441e-8be5-ecdcc8c6f683 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.890405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d21a-84db-441e-8be5-ecdcc8c6f683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.890405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d21a-84db-441e-8be5-ecdcc8c6f683 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.890809 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4d21a-84db-441e-8be5-ecdcc8c6f683 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:57.890809 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4d21a-84db-441e-8be5-ecdcc8c6f683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.890809 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4d21a-84db-441e-8be5-ecdcc8c6f683 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.891317 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 314/645] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:57.893571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd3415-4065-4f92-8554-2a56b257c727 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.906445 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 332/646] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:57.906624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd3415-4065-4f92-8554-2a56b257c727 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.909411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d21a-84db-441e-8be5-ecdcc8c6f683 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.914854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f12f4e-1eb6-465d-a0f2-8b4cbbfc6be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.915662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f12f4e-1eb6-465d-a0f2-8b4cbbfc6be5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.915937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f12f4e-1eb6-465d-a0f2-8b4cbbfc6be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.916208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f12f4e-1eb6-465d-a0f2-8b4cbbfc6be5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.920640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d21a-84db-441e-8be5-ecdcc8c6f683 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.924599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f12f4e-1eb6-465d-a0f2-8b4cbbfc6be5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.925851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c377d-f21e-4e5e-b1b7-9740140d73b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.926806 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f12f4e-1eb6-465d-a0f2-8b4cbbfc6be5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.926921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c377d-f21e-4e5e-b1b7-9740140d73b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.927502 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c377d-f21e-4e5e-b1b7-9740140d73b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.927875 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c377d-f21e-4e5e-b1b7-9740140d73b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.940090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c377d-f21e-4e5e-b1b7-9740140d73b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.942003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-25f12f4e-1eb6-465d-a0f2-8b4cbbfc6be5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 09 00:56:57.942110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c377d-f21e-4e5e-b1b7-9740140d73b3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:57.943626 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 315/647] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:57.944504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f12f4e-1eb6-465d-a0f2-8b4cbbfc6be5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.956164 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f12f4e-1eb6-465d-a0f2-8b4cbbfc6be5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.960728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966534fd-f0d2-4cb5-9dc6-ed2609a1531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.961529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966534fd-f0d2-4cb5-9dc6-ed2609a1531a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.961779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966534fd-f0d2-4cb5-9dc6-ed2609a1531a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.962047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966534fd-f0d2-4cb5-9dc6-ed2609a1531a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.966850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-4e2c377d-f21e-4e5e-b1b7-9740140d73b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:57.968462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 333/648] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:57.969587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c377d-f21e-4e5e-b1b7-9740140d73b3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.974180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966534fd-f0d2-4cb5-9dc6-ed2609a1531a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:56:57.980131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c377d-f21e-4e5e-b1b7-9740140d73b3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:57.981483 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-966534fd-f0d2-4cb5-9dc6-ed2609a1531a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:56:57.982766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 316/649] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:57.985948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aa30b-7adb-49df-a6ec-3b37c3710364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:57.987065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa30b-7adb-49df-a6ec-3b37c3710364 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:57.987413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa30b-7adb-49df-a6ec-3b37c3710364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:57.987753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa30b-7adb-49df-a6ec-3b37c3710364 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:57.988755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aa30b-7adb-49df-a6ec-3b37c3710364 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:57.988978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966534fd-f0d2-4cb5-9dc6-ed2609a1531a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:57.989241 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aa30b-7adb-49df-a6ec-3b37c3710364 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:57.991421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aa30b-7adb-49df-a6ec-3b37c3710364 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.000653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966534fd-f0d2-4cb5-9dc6-ed2609a1531a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.010498 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d07851-4b63-45d7-8e19-9c00c7454dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.011171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07851-4b63-45d7-8e19-9c00c7454dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.011455 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07851-4b63-45d7-8e19-9c00c7454dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.011733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07851-4b63-45d7-8e19-9c00c7454dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.012477 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d07851-4b63-45d7-8e19-9c00c7454dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.012779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d07851-4b63-45d7-8e19-9c00c7454dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.013254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 334/650] 10.222.0.23 () {56 vars in 1158 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.018460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aa30b-7adb-49df-a6ec-3b37c3710364 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.018609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d07851-4b63-45d7-8e19-9c00c7454dcd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.030109 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aa30b-7adb-49df-a6ec-3b37c3710364 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.030800 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 317/651] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.031682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d07851-4b63-45d7-8e19-9c00c7454dcd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.035938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2561bf-72cc-4610-b4ed-adeb3f1bced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.036753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2561bf-72cc-4610-b4ed-adeb3f1bced6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.037145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2561bf-72cc-4610-b4ed-adeb3f1bced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.037762 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2561bf-72cc-4610-b4ed-adeb3f1bced6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.039274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2561bf-72cc-4610-b4ed-adeb3f1bced6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.039701 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2561bf-72cc-4610-b4ed-adeb3f1bced6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.041701 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2561bf-72cc-4610-b4ed-adeb3f1bced6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.042755 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d07851-4b63-45d7-8e19-9c00c7454dcd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.048013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec1179-5ac8-4aa0-b21f-6e011069efad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.048668 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec1179-5ac8-4aa0-b21f-6e011069efad admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.049010 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec1179-5ac8-4aa0-b21f-6e011069efad admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.049290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec1179-5ac8-4aa0-b21f-6e011069efad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.052075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 335/652] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.052998 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2561bf-72cc-4610-b4ed-adeb3f1bced6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.063902 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec1179-5ac8-4aa0-b21f-6e011069efad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.067464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2561bf-72cc-4610-b4ed-adeb3f1bced6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.067721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec1179-5ac8-4aa0-b21f-6e011069efad admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.072114 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5cdb6-5d95-45ba-8075-7666b1fc23d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.073108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5cdb6-5d95-45ba-8075-7666b1fc23d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.073396 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5cdb6-5d95-45ba-8075-7666b1fc23d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.073669 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5cdb6-5d95-45ba-8075-7666b1fc23d2 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.079209 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 318/653] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:58.080248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec1179-5ac8-4aa0-b21f-6e011069efad admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.086481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5cdb6-5d95-45ba-8075-7666b1fc23d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.086481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5cdb6-5d95-45ba-8075-7666b1fc23d2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.095699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec1179-5ac8-4aa0-b21f-6e011069efad admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.101012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-32b5cdb6-5d95-45ba-8075-7666b1fc23d2 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 09 00:56:58.106398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 336/654] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:58.106398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5cdb6-5d95-45ba-8075-7666b1fc23d2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.115851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ed6d4-3671-40cb-9b47-fc273861c7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.117262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ed6d4-3671-40cb-9b47-fc273861c7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.117765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ed6d4-3671-40cb-9b47-fc273861c7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.118596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ed6d4-3671-40cb-9b47-fc273861c7c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.120866 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5cdb6-5d95-45ba-8075-7666b1fc23d2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.127716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f895f-cff3-437d-8f1b-49f6063946b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.128791 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f895f-cff3-437d-8f1b-49f6063946b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.129620 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f895f-cff3-437d-8f1b-49f6063946b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.130016 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f895f-cff3-437d-8f1b-49f6063946b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.134099 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ed6d4-3671-40cb-9b47-fc273861c7c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.136143 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ed6d4-3671-40cb-9b47-fc273861c7c1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.142967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f895f-cff3-437d-8f1b-49f6063946b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.145632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f895f-cff3-437d-8f1b-49f6063946b5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.154298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-e19ed6d4-3671-40cb-9b47-fc273861c7c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:58.156001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 319/655] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:58.156952 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ed6d4-3671-40cb-9b47-fc273861c7c1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.165531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-ea5f895f-cff3-437d-8f1b-49f6063946b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:58.167459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 337/656] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:58.172881 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f895f-cff3-437d-8f1b-49f6063946b5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.173007 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ed6d4-3671-40cb-9b47-fc273861c7c1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.178076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50111e18-1cf1-4bee-b34b-1292c8f6c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.179062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50111e18-1cf1-4bee-b34b-1292c8f6c8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.179675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50111e18-1cf1-4bee-b34b-1292c8f6c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.180163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50111e18-1cf1-4bee-b34b-1292c8f6c8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.181280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50111e18-1cf1-4bee-b34b-1292c8f6c8d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.181829 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50111e18-1cf1-4bee-b34b-1292c8f6c8d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.182639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f895f-cff3-437d-8f1b-49f6063946b5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.184704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50111e18-1cf1-4bee-b34b-1292c8f6c8d3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.187400 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224b91d-b4ab-4715-88be-6d3d0c8043a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.188042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224b91d-b4ab-4715-88be-6d3d0c8043a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.188331 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224b91d-b4ab-4715-88be-6d3d0c8043a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.189239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224b91d-b4ab-4715-88be-6d3d0c8043a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.190596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224b91d-b4ab-4715-88be-6d3d0c8043a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.191995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224b91d-b4ab-4715-88be-6d3d0c8043a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.193946 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224b91d-b4ab-4715-88be-6d3d0c8043a1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.207662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 338/657] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.208971 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224b91d-b4ab-4715-88be-6d3d0c8043a1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.210861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 320/658] 10.222.0.23 () {56 vars in 1160 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.216305 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50111e18-1cf1-4bee-b34b-1292c8f6c8d3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.221874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224b91d-b4ab-4715-88be-6d3d0c8043a1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.226893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a2dc3-7d19-4bef-ba95-64ab671da286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.227846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2dc3-7d19-4bef-ba95-64ab671da286 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.227954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50111e18-1cf1-4bee-b34b-1292c8f6c8d3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.228570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2dc3-7d19-4bef-ba95-64ab671da286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.229296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2dc3-7d19-4bef-ba95-64ab671da286 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.230517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a2dc3-7d19-4bef-ba95-64ab671da286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.231231 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a2dc3-7d19-4bef-ba95-64ab671da286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.232547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7286e16-bedc-4226-a8d0-95957af855e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.233323 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7286e16-bedc-4226-a8d0-95957af855e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.233604 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7286e16-bedc-4226-a8d0-95957af855e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.233882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7286e16-bedc-4226-a8d0-95957af855e6 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.234270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a2dc3-7d19-4bef-ba95-64ab671da286 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.244941 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7286e16-bedc-4226-a8d0-95957af855e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.247321 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7286e16-bedc-4226-a8d0-95957af855e6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.252044 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 339/659] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.257233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a2dc3-7d19-4bef-ba95-64ab671da286 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.265117 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-c7286e16-bedc-4226-a8d0-95957af855e6 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 09 00:56:58.266786 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 321/660] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:58.267764 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7286e16-bedc-4226-a8d0-95957af855e6 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.268478 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a2dc3-7d19-4bef-ba95-64ab671da286 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.273439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847ba5d-f643-48ab-92b8-c90d100ace77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.274346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847ba5d-f643-48ab-92b8-c90d100ace77 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.274840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847ba5d-f643-48ab-92b8-c90d100ace77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.275337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847ba5d-f643-48ab-92b8-c90d100ace77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.277789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7286e16-bedc-4226-a8d0-95957af855e6 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.283259 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d2c64-56db-4ced-9417-cc97b493170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.284683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d2c64-56db-4ced-9417-cc97b493170d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.285039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d2c64-56db-4ced-9417-cc97b493170d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.285384 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d2c64-56db-4ced-9417-cc97b493170d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.287036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847ba5d-f643-48ab-92b8-c90d100ace77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.289084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847ba5d-f643-48ab-92b8-c90d100ace77 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.293308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d2c64-56db-4ced-9417-cc97b493170d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.296326 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d2c64-56db-4ced-9417-cc97b493170d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.300460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 340/661] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:56:58.301435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847ba5d-f643-48ab-92b8-c90d100ace77 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.310767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847ba5d-f643-48ab-92b8-c90d100ace77 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.315760 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0b35a-5c91-466d-86db-c41c649f76bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.316621 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0b35a-5c91-466d-86db-c41c649f76bb admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.317074 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0b35a-5c91-466d-86db-c41c649f76bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.317241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-411d2c64-56db-4ced-9417-cc97b493170d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:58.317725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0b35a-5c91-466d-86db-c41c649f76bb admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.318788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0b35a-5c91-466d-86db-c41c649f76bb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.322399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 322/662] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:58.322399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d2c64-56db-4ced-9417-cc97b493170d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.324213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0b35a-5c91-466d-86db-c41c649f76bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.325443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0b35a-5c91-466d-86db-c41c649f76bb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.339563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d2c64-56db-4ced-9417-cc97b493170d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.344393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa5cd9-25a6-425a-a275-1f6367725bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.346247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa5cd9-25a6-425a-a275-1f6367725bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.346694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa5cd9-25a6-425a-a275-1f6367725bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.347080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa5cd9-25a6-425a-a275-1f6367725bc4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.350320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 341/663] 10.222.0.23 () {56 vars in 1156 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.351473 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0b35a-5c91-466d-86db-c41c649f76bb admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.359731 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa5cd9-25a6-425a-a275-1f6367725bc4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.362906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa5cd9-25a6-425a-a275-1f6367725bc4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.363585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0b35a-5c91-466d-86db-c41c649f76bb admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.368577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45780b0a-c702-4c29-b088-9bcba95aed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.369471 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45780b0a-c702-4c29-b088-9bcba95aed15 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.369936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45780b0a-c702-4c29-b088-9bcba95aed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.370462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45780b0a-c702-4c29-b088-9bcba95aed15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.371407 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45780b0a-c702-4c29-b088-9bcba95aed15 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.371904 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45780b0a-c702-4c29-b088-9bcba95aed15 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.373995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45780b0a-c702-4c29-b088-9bcba95aed15 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.382511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-36aa5cd9-25a6-425a-a275-1f6367725bc4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:58.386513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 323/664] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:58.387458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa5cd9-25a6-425a-a275-1f6367725bc4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.393472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 342/665] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.398464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45780b0a-c702-4c29-b088-9bcba95aed15 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.405873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa5cd9-25a6-425a-a275-1f6367725bc4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.408575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45780b0a-c702-4c29-b088-9bcba95aed15 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.411552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5b81-1723-43db-aed5-496847cac772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.412816 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5b81-1723-43db-aed5-496847cac772 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.413247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5b81-1723-43db-aed5-496847cac772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.413458 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168fca4-27f9-4b5f-89b7-4f80cf8ba3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.413937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5b81-1723-43db-aed5-496847cac772 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.414293 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168fca4-27f9-4b5f-89b7-4f80cf8ba3ea admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.414854 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168fca4-27f9-4b5f-89b7-4f80cf8ba3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.415241 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168fca4-27f9-4b5f-89b7-4f80cf8ba3ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.416074 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168fca4-27f9-4b5f-89b7-4f80cf8ba3ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.416498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168fca4-27f9-4b5f-89b7-4f80cf8ba3ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.418196 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168fca4-27f9-4b5f-89b7-4f80cf8ba3ea admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.427411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb5b81-1723-43db-aed5-496847cac772 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.429479 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb5b81-1723-43db-aed5-496847cac772 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.431234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 343/666] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.436772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168fca4-27f9-4b5f-89b7-4f80cf8ba3ea admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.446403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168fca4-27f9-4b5f-89b7-4f80cf8ba3ea admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.448213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-affb5b81-1723-43db-aed5-496847cac772 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:56:58.450017 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 324/667] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:58.451272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e405115-937c-4d14-b172-8ae390249cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.451430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5b81-1723-43db-aed5-496847cac772 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.452124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405115-937c-4d14-b172-8ae390249cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.452534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405115-937c-4d14-b172-8ae390249cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.452892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405115-937c-4d14-b172-8ae390249cf4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.453843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e405115-937c-4d14-b172-8ae390249cf4 admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=fb5625c813724729bb927c201f23e417) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.454846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e405115-937c-4d14-b172-8ae390249cf4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.456874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e405115-937c-4d14-b172-8ae390249cf4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.463536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5b81-1723-43db-aed5-496847cac772 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.463696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 344/668] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/role_assignments?user.id=fb5625c813724729bb927c201f23e417&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.470581 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e405115-937c-4d14-b172-8ae390249cf4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.484655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad012f-e7e9-470d-bebc-6b3e2345edd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.485795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad012f-e7e9-470d-bebc-6b3e2345edd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.486195 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad012f-e7e9-470d-bebc-6b3e2345edd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.487080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad012f-e7e9-470d-bebc-6b3e2345edd1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.493291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e405115-937c-4d14-b172-8ae390249cf4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.504617 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad012f-e7e9-470d-bebc-6b3e2345edd1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.507241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad012f-e7e9-470d-bebc-6b3e2345edd1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.519171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05a166-5f53-42eb-a449-7d03e5355bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.519846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05a166-5f53-42eb-a449-7d03e5355bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.520131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05a166-5f53-42eb-a449-7d03e5355bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.520402 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05a166-5f53-42eb-a449-7d03e5355bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.521144 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05a166-5f53-42eb-a449-7d03e5355bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.521447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05a166-5f53-42eb-a449-7d03e5355bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.523094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05a166-5f53-42eb-a449-7d03e5355bb2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.525898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-ffad012f-e7e9-470d-bebc-6b3e2345edd1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:58.527309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 325/669] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:56:58.534213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad012f-e7e9-470d-bebc-6b3e2345edd1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.544462 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad012f-e7e9-470d-bebc-6b3e2345edd1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.551674 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 345/670] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.553263 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6d705-cb20-4ef2-b871-cf9bf7a0aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.553940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6d705-cb20-4ef2-b871-cf9bf7a0aad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.554225 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6d705-cb20-4ef2-b871-cf9bf7a0aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.554549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6d705-cb20-4ef2-b871-cf9bf7a0aad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.555368 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6d705-cb20-4ef2-b871-cf9bf7a0aad0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.555681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6d705-cb20-4ef2-b871-cf9bf7a0aad0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.557772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05a166-5f53-42eb-a449-7d03e5355bb2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.559107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6d705-cb20-4ef2-b871-cf9bf7a0aad0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.575473 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05a166-5f53-42eb-a449-7d03e5355bb2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.583099 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 326/671] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:56:58.591124 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6d705-cb20-4ef2-b871-cf9bf7a0aad0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.592129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee064de-9f86-4f37-96d1-bcaa749181ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.592937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee064de-9f86-4f37-96d1-bcaa749181ab admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.593220 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee064de-9f86-4f37-96d1-bcaa749181ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.593496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee064de-9f86-4f37-96d1-bcaa749181ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.606910 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee064de-9f86-4f37-96d1-bcaa749181ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.608916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee064de-9f86-4f37-96d1-bcaa749181ab admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.615964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6d705-cb20-4ef2-b871-cf9bf7a0aad0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.629879 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-aee064de-9f86-4f37-96d1-bcaa749181ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:56:58.633270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f8829-b197-42cd-add2-5d7657e3be0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.633937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f8829-b197-42cd-add2-5d7657e3be0d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.634220 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f8829-b197-42cd-add2-5d7657e3be0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.634524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f8829-b197-42cd-add2-5d7657e3be0d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.635384 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f8829-b197-42cd-add2-5d7657e3be0d admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=0ab73b6f3a1949359549f91e1b708600) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.635701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f8829-b197-42cd-add2-5d7657e3be0d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.637661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f8829-b197-42cd-add2-5d7657e3be0d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.643897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 346/672] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:56:58.645498 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 327/673] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/role_assignments?user.id=0ab73b6f3a1949359549f91e1b708600&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 608 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.650332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee064de-9f86-4f37-96d1-bcaa749181ab admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.669276 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee064de-9f86-4f37-96d1-bcaa749181ab admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.679803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565f1a3-6a7d-436b-82fe-d16c744c95d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.680812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565f1a3-6a7d-436b-82fe-d16c744c95d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.681241 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565f1a3-6a7d-436b-82fe-d16c744c95d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.681716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565f1a3-6a7d-436b-82fe-d16c744c95d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.682909 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565f1a3-6a7d-436b-82fe-d16c744c95d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:56:58.683380 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565f1a3-6a7d-436b-82fe-d16c744c95d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.685574 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565f1a3-6a7d-436b-82fe-d16c744c95d6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.706146 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 347/674] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:56:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:56:58.713377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f8829-b197-42cd-add2-5d7657e3be0d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:58.727767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f8829-b197-42cd-add2-5d7657e3be0d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:58.744244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b15f49-55c9-4269-b4e5-6427f27246cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:58.745148 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b15f49-55c9-4269-b4e5-6427f27246cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:58.745433 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b15f49-55c9-4269-b4e5-6427f27246cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:58.745706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b15f49-55c9-4269-b4e5-6427f27246cf admin admin] PATH_INFO: `/v3/projects/0566d367619740a48d8dca2def78a386/users/f2a17190105a4228bdd94926e1a2091e/roles/0de5bfc441494559af3a8cdd798c347e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:58.763015 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b15f49-55c9-4269-b4e5-6427f27246cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566d367619740a48d8dca2def78a386, user_id=f2a17190105a4228bdd94926e1a2091e, role_id=0de5bfc441494559af3a8cdd798c347e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:56:58.765724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b15f49-55c9-4269-b4e5-6427f27246cf admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:56:58.789364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 328/675] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:56:58 2021] PUT /identity/v3/projects/0566d367619740a48d8dca2def78a386/users/f2a17190105a4228bdd94926e1a2091e/roles/0de5bfc441494559af3a8cdd798c347e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:56:59.800316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717f0f0-5958-48b7-b305-aa8726758f9e None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:59.800869 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717f0f0-5958-48b7-b305-aa8726758f9e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:59.801087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717f0f0-5958-48b7-b305-aa8726758f9e None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:59.803629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 348/676] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:56:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:56:59.808829 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c212f-78b7-4335-afbb-d5867d79b442 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:59.809280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c212f-78b7-4335-afbb-d5867d79b442 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:59.809369 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c212f-78b7-4335-afbb-d5867d79b442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:56:59.835813 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-9b1c212f-78b7-4335-afbb-d5867d79b442 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:56:59.837027 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9b1c212f-78b7-4335-afbb-d5867d79b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:56:59.917055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 329/677] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:56:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:56:59.970846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717f0f0-5958-48b7-b305-aa8726758f9e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:56:59.989365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717f0f0-5958-48b7-b305-aa8726758f9e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:56:59.996811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a41bc5-ad84-403b-bcaf-e3f9628edfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:56:59.997604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a41bc5-ad84-403b-bcaf-e3f9628edfcd admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:56:59.997885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a41bc5-ad84-403b-bcaf-e3f9628edfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:56:59.998160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a41bc5-ad84-403b-bcaf-e3f9628edfcd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.017031 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a41bc5-ad84-403b-bcaf-e3f9628edfcd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:00.018910 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a41bc5-ad84-403b-bcaf-e3f9628edfcd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:00.041721 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-19a41bc5-ad84-403b-bcaf-e3f9628edfcd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:00.042978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 349/678] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:56:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:00.049883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c212f-78b7-4335-afbb-d5867d79b442 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:00.061424 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c212f-78b7-4335-afbb-d5867d79b442 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:00.076881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61c70-6158-4697-9337-dbd39c47152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:00.077724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61c70-6158-4697-9337-dbd39c47152e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.078114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61c70-6158-4697-9337-dbd39c47152e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.078540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61c70-6158-4697-9337-dbd39c47152e admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.080149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c61c70-6158-4697-9337-dbd39c47152e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:00.082015 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c61c70-6158-4697-9337-dbd39c47152e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:00.083818 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c61c70-6158-4697-9337-dbd39c47152e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:00.098037 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 330/679] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:00.103675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a41bc5-ad84-403b-bcaf-e3f9628edfcd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:00.119302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a41bc5-ad84-403b-bcaf-e3f9628edfcd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:00.127469 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dad6c-2395-44ee-bdac-23020fab2795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:00.128129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dad6c-2395-44ee-bdac-23020fab2795 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.128411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dad6c-2395-44ee-bdac-23020fab2795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.128683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dad6c-2395-44ee-bdac-23020fab2795 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.129415 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dad6c-2395-44ee-bdac-23020fab2795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:00.131371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dad6c-2395-44ee-bdac-23020fab2795 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:00.166163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 350/680] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:57:00 2021] POST /identity/v3/users => generated 254 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:00.407952 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29893489-1604-4fa6-a5d4-d40b18b9da3a None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.408414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29893489-1604-4fa6-a5d4-d40b18b9da3a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.408810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29893489-1604-4fa6-a5d4-d40b18b9da3a None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.411092 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 331/681] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:00.417400 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162d0be-a55c-46e8-a8c4-f1bc1548e678 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.417827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162d0be-a55c-46e8-a8c4-f1bc1548e678 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.418212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162d0be-a55c-46e8-a8c4-f1bc1548e678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.447583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-4162d0be-a55c-46e8-a8c4-f1bc1548e678 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:00.449036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-4162d0be-a55c-46e8-a8c4-f1bc1548e678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:00.460778 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 351/682] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:57:00.487642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29893489-1604-4fa6-a5d4-d40b18b9da3a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:00.500598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29893489-1604-4fa6-a5d4-d40b18b9da3a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:00.505463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709c4a2-aa7d-4abc-998b-17e1ec5d0bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:00.506409 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709c4a2-aa7d-4abc-998b-17e1ec5d0bca admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.506807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709c4a2-aa7d-4abc-998b-17e1ec5d0bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.507188 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709c4a2-aa7d-4abc-998b-17e1ec5d0bca admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.524710 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709c4a2-aa7d-4abc-998b-17e1ec5d0bca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:00.531928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-a709c4a2-aa7d-4abc-998b-17e1ec5d0bca admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:57:00.534012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 332/683] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:00.539966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162d0be-a55c-46e8-a8c4-f1bc1548e678 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:00.550150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162d0be-a55c-46e8-a8c4-f1bc1548e678 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:00.555174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8f2c8-feb9-48ea-b75a-cda1889eb953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:00.555990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8f2c8-feb9-48ea-b75a-cda1889eb953 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.556380 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8f2c8-feb9-48ea-b75a-cda1889eb953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.556758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8f2c8-feb9-48ea-b75a-cda1889eb953 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.557649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8f2c8-feb9-48ea-b75a-cda1889eb953 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:00.558070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8f2c8-feb9-48ea-b75a-cda1889eb953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:00.559867 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8f2c8-feb9-48ea-b75a-cda1889eb953 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:00.570406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 352/684] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:57:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:00.576465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709c4a2-aa7d-4abc-998b-17e1ec5d0bca admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:00.591283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709c4a2-aa7d-4abc-998b-17e1ec5d0bca admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:00.596344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6183550-17c5-4125-a4b6-c8da5a4d4be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:00.597129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6183550-17c5-4125-a4b6-c8da5a4d4be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.597406 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6183550-17c5-4125-a4b6-c8da5a4d4be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.597682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6183550-17c5-4125-a4b6-c8da5a4d4be9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.609901 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6183550-17c5-4125-a4b6-c8da5a4d4be9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:00.612466 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6183550-17c5-4125-a4b6-c8da5a4d4be9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:00.629980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-c6183550-17c5-4125-a4b6-c8da5a4d4be9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:00.631545 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 333/685] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:00.637499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8f2c8-feb9-48ea-b75a-cda1889eb953 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:00.651361 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8f2c8-feb9-48ea-b75a-cda1889eb953 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:00.656986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2824f-a9c0-45e8-8ae3-665419137b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:00.658450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2824f-a9c0-45e8-8ae3-665419137b08 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.658657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2824f-a9c0-45e8-8ae3-665419137b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.658886 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2824f-a9c0-45e8-8ae3-665419137b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.659715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2824f-a9c0-45e8-8ae3-665419137b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:00.660016 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2824f-a9c0-45e8-8ae3-665419137b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:00.661653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2824f-a9c0-45e8-8ae3-665419137b08 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:00.675320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 353/686] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:00.683204 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6183550-17c5-4125-a4b6-c8da5a4d4be9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:00.694185 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6183550-17c5-4125-a4b6-c8da5a4d4be9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:00.702446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0dd4b-65a5-4133-a686-d9e069cf8ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:00.703443 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0dd4b-65a5-4133-a686-d9e069cf8ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.703865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0dd4b-65a5-4133-a686-d9e069cf8ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.705051 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0dd4b-65a5-4133-a686-d9e069cf8ef3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.713555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0dd4b-65a5-4133-a686-d9e069cf8ef3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:00.715654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0dd4b-65a5-4133-a686-d9e069cf8ef3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:00.730862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-d8e0dd4b-65a5-4133-a686-d9e069cf8ef3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 09 00:57:00.732320 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 334/687] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Dec 9 00:57:00 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:00.738806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2824f-a9c0-45e8-8ae3-665419137b08 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:00.749939 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2824f-a9c0-45e8-8ae3-665419137b08 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:00.755627 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c828ee0-5fbe-4399-b2e7-9d9aa3ce3a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:00.756356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828ee0-5fbe-4399-b2e7-9d9aa3ce3a80 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.756701 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828ee0-5fbe-4399-b2e7-9d9aa3ce3a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.757043 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828ee0-5fbe-4399-b2e7-9d9aa3ce3a80 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.757960 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c828ee0-5fbe-4399-b2e7-9d9aa3ce3a80 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:00.758387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c828ee0-5fbe-4399-b2e7-9d9aa3ce3a80 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:00.760280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c828ee0-5fbe-4399-b2e7-9d9aa3ce3a80 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:00.778462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 354/688] 10.222.0.23 () {56 vars in 1154 bytes} [Thu Dec 9 00:57:00 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:00.785720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0dd4b-65a5-4133-a686-d9e069cf8ef3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:00.795678 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0dd4b-65a5-4133-a686-d9e069cf8ef3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:00.800903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c19bd9-9dd9-4bd3-8b82-f3810726a6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:00.801684 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c19bd9-9dd9-4bd3-8b82-f3810726a6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.802068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c19bd9-9dd9-4bd3-8b82-f3810726a6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.802526 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c19bd9-9dd9-4bd3-8b82-f3810726a6f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.810767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c19bd9-9dd9-4bd3-8b82-f3810726a6f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:00.812626 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c19bd9-9dd9-4bd3-8b82-f3810726a6f4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:00.821683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 335/689] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:57:00.827228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c828ee0-5fbe-4399-b2e7-9d9aa3ce3a80 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:00.837536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c828ee0-5fbe-4399-b2e7-9d9aa3ce3a80 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:00.842142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f37d8-7423-45d1-8028-5f8f41907c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:00.843084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f37d8-7423-45d1-8028-5f8f41907c3d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.843433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f37d8-7423-45d1-8028-5f8f41907c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.843776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f37d8-7423-45d1-8028-5f8f41907c3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.864101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f37d8-7423-45d1-8028-5f8f41907c3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:00.866042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f37d8-7423-45d1-8028-5f8f41907c3d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:00.883316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-e70f37d8-7423-45d1-8028-5f8f41907c3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:00.884919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 355/690] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:00.890518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c19bd9-9dd9-4bd3-8b82-f3810726a6f4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:00.912395 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c19bd9-9dd9-4bd3-8b82-f3810726a6f4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:00.923605 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56775b1-4a74-4d19-b426-1975ba3732fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:00.924257 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56775b1-4a74-4d19-b426-1975ba3732fc admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.924537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56775b1-4a74-4d19-b426-1975ba3732fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.924808 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56775b1-4a74-4d19-b426-1975ba3732fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.925535 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56775b1-4a74-4d19-b426-1975ba3732fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:00.925838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56775b1-4a74-4d19-b426-1975ba3732fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:00.927457 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56775b1-4a74-4d19-b426-1975ba3732fc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:00.951488 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 336/691] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:00.957907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f37d8-7423-45d1-8028-5f8f41907c3d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:00.967911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f37d8-7423-45d1-8028-5f8f41907c3d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:00.972618 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f9e29-f977-4c07-8364-2485c4aaaebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:00.973561 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f9e29-f977-4c07-8364-2485c4aaaebc admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:00.973944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f9e29-f977-4c07-8364-2485c4aaaebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:00.974339 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f9e29-f977-4c07-8364-2485c4aaaebc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:00.982217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f9e29-f977-4c07-8364-2485c4aaaebc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:00.984449 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f9e29-f977-4c07-8364-2485c4aaaebc admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:01.005576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-293f9e29-f977-4c07-8364-2485c4aaaebc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:01.007057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 356/692] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:01.012969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56775b1-4a74-4d19-b426-1975ba3732fc admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:01.026673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56775b1-4a74-4d19-b426-1975ba3732fc admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:01.031237 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319cf4-011f-4c50-87ec-a92d71638b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:01.031940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319cf4-011f-4c50-87ec-a92d71638b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:01.032349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319cf4-011f-4c50-87ec-a92d71638b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:01.032593 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319cf4-011f-4c50-87ec-a92d71638b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:01.033401 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319cf4-011f-4c50-87ec-a92d71638b44 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:01.033714 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319cf4-011f-4c50-87ec-a92d71638b44 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:01.035658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319cf4-011f-4c50-87ec-a92d71638b44 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:01.052809 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 337/693] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:01.058716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f9e29-f977-4c07-8364-2485c4aaaebc admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:01.071374 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f9e29-f977-4c07-8364-2485c4aaaebc admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:01.078534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e5175-38fc-4104-9801-21bc33a910af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:01.079315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e5175-38fc-4104-9801-21bc33a910af admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:01.079895 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e5175-38fc-4104-9801-21bc33a910af admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:01.080178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e5175-38fc-4104-9801-21bc33a910af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:01.081075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e5175-38fc-4104-9801-21bc33a910af admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=53d32ba063bc4a719d4c2f67d88ec640) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:01.081392 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e5175-38fc-4104-9801-21bc33a910af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:01.083362 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e5175-38fc-4104-9801-21bc33a910af admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:01.091708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 357/694] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:01 2021] GET /identity/v3/role_assignments?user.id=53d32ba063bc4a719d4c2f67d88ec640&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:01.755888 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c2e82-34c8-4eff-9372-7aedeef93652 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:01.756336 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c2e82-34c8-4eff-9372-7aedeef93652 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:01.756716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c2e82-34c8-4eff-9372-7aedeef93652 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:01.759023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 338/695] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:01.760563 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e276f-9661-4dd3-8239-481e09f99f1a None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:01.760850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e276f-9661-4dd3-8239-481e09f99f1a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:01.761125 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e276f-9661-4dd3-8239-481e09f99f1a None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:01.762897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 358/696] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:01.768578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25521dd3-4250-42f7-bbd3-504edb45c230 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:01.768865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25521dd3-4250-42f7-bbd3-504edb45c230 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:01.769145 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25521dd3-4250-42f7-bbd3-504edb45c230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:01.777791 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000134a7-3219-4380-9ebf-b6ea9e84a7ae None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:01.778067 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000134a7-3219-4380-9ebf-b6ea9e84a7ae None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:01.778345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000134a7-3219-4380-9ebf-b6ea9e84a7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:01.794256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-25521dd3-4250-42f7-bbd3-504edb45c230 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:01.801144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-25521dd3-4250-42f7-bbd3-504edb45c230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:01.804468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 339/697] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:57:01.811372 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-000134a7-3219-4380-9ebf-b6ea9e84a7ae None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:01.812775 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-000134a7-3219-4380-9ebf-b6ea9e84a7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:01.826751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 359/698] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:57:01.827114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25521dd3-4250-42f7-bbd3-504edb45c230 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:01.841253 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25521dd3-4250-42f7-bbd3-504edb45c230 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:01.863109 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed00311-d2ae-4ba0-bc7d-abf44df3d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:01.863926 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed00311-d2ae-4ba0-bc7d-abf44df3d342 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:01.864208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed00311-d2ae-4ba0-bc7d-abf44df3d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:01.864487 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed00311-d2ae-4ba0-bc7d-abf44df3d342 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:01.865168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed00311-d2ae-4ba0-bc7d-abf44df3d342 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:01.866186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-4ed00311-d2ae-4ba0-bc7d-abf44df3d342 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:57:01.866186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:57:01.866186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:57:01.867107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed00311-d2ae-4ba0-bc7d-abf44df3d342 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:01.879289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000134a7-3219-4380-9ebf-b6ea9e84a7ae None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:01.882791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-4ed00311-d2ae-4ba0-bc7d-abf44df3d342 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 09 00:57:01.885218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 340/699] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:01 2021] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:01.890479 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed00311-d2ae-4ba0-bc7d-abf44df3d342 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:01.894015 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000134a7-3219-4380-9ebf-b6ea9e84a7ae None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:01.900292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed00311-d2ae-4ba0-bc7d-abf44df3d342 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:01.902646 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c946be-ec1b-42c0-abf6-b532ef341119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:01.903720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c946be-ec1b-42c0-abf6-b532ef341119 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:01.904007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c946be-ec1b-42c0-abf6-b532ef341119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:01.904281 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c946be-ec1b-42c0-abf6-b532ef341119 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:01.905044 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c946be-ec1b-42c0-abf6-b532ef341119 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:01.905404 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f52d99-a528-41bb-8453-123dfb5af49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:01.906053 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-c7c946be-ec1b-42c0-abf6-b532ef341119 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:57:01.906053 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:57:01.906053 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:57:01.906509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f52d99-a528-41bb-8453-123dfb5af49b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:01.906953 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c946be-ec1b-42c0-abf6-b532ef341119 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:01.907608 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f52d99-a528-41bb-8453-123dfb5af49b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:01.908019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f52d99-a528-41bb-8453-123dfb5af49b admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:01.908885 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f52d99-a528-41bb-8453-123dfb5af49b admin admin] RBAC: Adding query filter params (name=network) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:01.909337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f52d99-a528-41bb-8453-123dfb5af49b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:01.910506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-69f52d99-a528-41bb-8453-123dfb5af49b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:57:01.910506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:57:01.910506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:57:01.911661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f52d99-a528-41bb-8453-123dfb5af49b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:01.917307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 341/700] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:01 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:01.923298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f52d99-a528-41bb-8453-123dfb5af49b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:01.932328 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-c7c946be-ec1b-42c0-abf6-b532ef341119 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 09 00:57:01.933299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f52d99-a528-41bb-8453-123dfb5af49b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:01.933543 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 360/701] 10.222.0.23 () {56 vars in 1150 bytes} [Thu Dec 9 00:57:01 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:01.942949 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c946be-ec1b-42c0-abf6-b532ef341119 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:01.944378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d15391-f35c-4dfa-af49-33e49eb78af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:01.945224 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15391-f35c-4dfa-af49-33e49eb78af2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:01.945672 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15391-f35c-4dfa-af49-33e49eb78af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:01.946100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15391-f35c-4dfa-af49-33e49eb78af2 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:01.947047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d15391-f35c-4dfa-af49-33e49eb78af2 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:01.947509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d15391-f35c-4dfa-af49-33e49eb78af2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:01.949229 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d15391-f35c-4dfa-af49-33e49eb78af2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:01.952689 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c946be-ec1b-42c0-abf6-b532ef341119 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:01.956119 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 342/702] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:01 2021] GET /identity/v3/services?type=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:01.967324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11122fb3-f3bb-48e0-b991-6c5454f757c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:01.968007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11122fb3-f3bb-48e0-b991-6c5454f757c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:01.968284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11122fb3-f3bb-48e0-b991-6c5454f757c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:01.968554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11122fb3-f3bb-48e0-b991-6c5454f757c9 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:01.969299 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11122fb3-f3bb-48e0-b991-6c5454f757c9 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:01.970147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11122fb3-f3bb-48e0-b991-6c5454f757c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:01.971209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-11122fb3-f3bb-48e0-b991-6c5454f757c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:57:01.971209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:57:01.971209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:57:01.972101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11122fb3-f3bb-48e0-b991-6c5454f757c9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:01.984812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 361/703] 10.222.0.23 () {56 vars in 1145 bytes} [Thu Dec 9 00:57:01 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:01.991811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d15391-f35c-4dfa-af49-33e49eb78af2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:01.996420 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7927fc-12b4-4017-9e0b-fb15a286b6dd None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:01.996715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7927fc-12b4-4017-9e0b-fb15a286b6dd None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:01.996997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7927fc-12b4-4017-9e0b-fb15a286b6dd None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:01.999035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 362/704] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:57:02.010478 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b70289-dc4f-4675-beb4-4aa65a0395d8 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.010478 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b70289-dc4f-4675-beb4-4aa65a0395d8 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.010478 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b70289-dc4f-4675-beb4-4aa65a0395d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.010815 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d15391-f35c-4dfa-af49-33e49eb78af2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.025003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e5f58-6b48-479e-b5ab-a044701a6246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.025684 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5f58-6b48-479e-b5ab-a044701a6246 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.025965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5f58-6b48-479e-b5ab-a044701a6246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.026239 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5f58-6b48-479e-b5ab-a044701a6246 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.027004 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e5f58-6b48-479e-b5ab-a044701a6246 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:02.027312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e5f58-6b48-479e-b5ab-a044701a6246 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:02.028929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e5f58-6b48-479e-b5ab-a044701a6246 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:02.038208 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-96b70289-dc4f-4675-beb4-4aa65a0395d8 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:02.039459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-96b70289-dc4f-4675-beb4-4aa65a0395d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:02.042311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 343/705] 10.222.0.23 () {56 vars in 1145 bytes} [Thu Dec 9 00:57:01 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:02.056592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 363/706] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:57:02.105905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e5f58-6b48-479e-b5ab-a044701a6246 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:02.119956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e5f58-6b48-479e-b5ab-a044701a6246 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.124596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ee6f-e23c-4ce6-8bc1-3ba9c16e6e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.125570 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ee6f-e23c-4ce6-8bc1-3ba9c16e6e02 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.125916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ee6f-e23c-4ce6-8bc1-3ba9c16e6e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.126275 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ee6f-e23c-4ce6-8bc1-3ba9c16e6e02 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.138124 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76ee6f-e23c-4ce6-8bc1-3ba9c16e6e02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:02.146482 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-cd76ee6f-e23c-4ce6-8bc1-3ba9c16e6e02 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:57:02.148053 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 344/707] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:57:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:02.154542 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b70289-dc4f-4675-beb4-4aa65a0395d8 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:02.164559 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b70289-dc4f-4675-beb4-4aa65a0395d8 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.169377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de8948-4f30-4fd4-918e-853a3977dbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.170071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de8948-4f30-4fd4-918e-853a3977dbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.170354 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de8948-4f30-4fd4-918e-853a3977dbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.170673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de8948-4f30-4fd4-918e-853a3977dbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.171456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de8948-4f30-4fd4-918e-853a3977dbf5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:02.171764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de8948-4f30-4fd4-918e-853a3977dbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:02.174393 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de8948-4f30-4fd4-918e-853a3977dbf5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:02.184061 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 364/708] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:57:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:02.190629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ee6f-e23c-4ce6-8bc1-3ba9c16e6e02 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:02.201091 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ee6f-e23c-4ce6-8bc1-3ba9c16e6e02 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.206791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7548ce-35f4-468a-ad48-9881ddb61ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.207596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7548ce-35f4-468a-ad48-9881ddb61ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.207879 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7548ce-35f4-468a-ad48-9881ddb61ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.208154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7548ce-35f4-468a-ad48-9881ddb61ae7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.220399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7548ce-35f4-468a-ad48-9881ddb61ae7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:02.222433 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7548ce-35f4-468a-ad48-9881ddb61ae7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:02.241826 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-7b7548ce-35f4-468a-ad48-9881ddb61ae7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:02.243454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 345/709] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:02.249847 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de8948-4f30-4fd4-918e-853a3977dbf5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:02.261406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de8948-4f30-4fd4-918e-853a3977dbf5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.265970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb7c22-3a4a-4787-858a-1106220493df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.266761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb7c22-3a4a-4787-858a-1106220493df admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.267275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb7c22-3a4a-4787-858a-1106220493df admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.267642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb7c22-3a4a-4787-858a-1106220493df admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.268396 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb7c22-3a4a-4787-858a-1106220493df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:02.268706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb7c22-3a4a-4787-858a-1106220493df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:02.270325 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb7c22-3a4a-4787-858a-1106220493df admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:02.284322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 365/710] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:02.290549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7548ce-35f4-468a-ad48-9881ddb61ae7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:02.301665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7548ce-35f4-468a-ad48-9881ddb61ae7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.310683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e481dd-b5c8-437d-ab54-23cd86d69a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.311496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e481dd-b5c8-437d-ab54-23cd86d69a09 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.311779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e481dd-b5c8-437d-ab54-23cd86d69a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.312054 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e481dd-b5c8-437d-ab54-23cd86d69a09 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.325378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e481dd-b5c8-437d-ab54-23cd86d69a09 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:02.327446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e481dd-b5c8-437d-ab54-23cd86d69a09 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:02.343521 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-f7e481dd-b5c8-437d-ab54-23cd86d69a09 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 09 00:57:02.343851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 346/711] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:02 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:02.350292 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb7c22-3a4a-4787-858a-1106220493df admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:02.363950 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb7c22-3a4a-4787-858a-1106220493df admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.368935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a7223-1927-4971-9a3b-ab30595f3d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.369859 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a7223-1927-4971-9a3b-ab30595f3d42 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.370356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a7223-1927-4971-9a3b-ab30595f3d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.370858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a7223-1927-4971-9a3b-ab30595f3d42 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.371911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a7223-1927-4971-9a3b-ab30595f3d42 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:02.372441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a7223-1927-4971-9a3b-ab30595f3d42 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:02.374617 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a7223-1927-4971-9a3b-ab30595f3d42 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:02.393697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 366/712] 10.222.0.23 () {56 vars in 1156 bytes} [Thu Dec 9 00:57:02 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:02.399517 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e481dd-b5c8-437d-ab54-23cd86d69a09 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:02.411210 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e481dd-b5c8-437d-ab54-23cd86d69a09 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.416350 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f62e9e-b309-4f41-8413-5cd3bc644d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.417428 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f62e9e-b309-4f41-8413-5cd3bc644d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.417919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f62e9e-b309-4f41-8413-5cd3bc644d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.418461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f62e9e-b309-4f41-8413-5cd3bc644d1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.428292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f62e9e-b309-4f41-8413-5cd3bc644d1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:02.430468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f62e9e-b309-4f41-8413-5cd3bc644d1d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:02.440843 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 347/713] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:57:02.450406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a7223-1927-4971-9a3b-ab30595f3d42 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:02.463293 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a7223-1927-4971-9a3b-ab30595f3d42 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.474768 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d22946-712a-40b1-885b-5239b4565cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.475552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d22946-712a-40b1-885b-5239b4565cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.475827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d22946-712a-40b1-885b-5239b4565cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.476096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d22946-712a-40b1-885b-5239b4565cf1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.490268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d22946-712a-40b1-885b-5239b4565cf1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:02.492115 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d22946-712a-40b1-885b-5239b4565cf1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:02.522577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-d3d22946-712a-40b1-885b-5239b4565cf1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:02.528561 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 367/714] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:02.529790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f62e9e-b309-4f41-8413-5cd3bc644d1d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:02.544726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f62e9e-b309-4f41-8413-5cd3bc644d1d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.549357 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce18e20-6600-4e60-916c-41b7529a1153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.550007 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce18e20-6600-4e60-916c-41b7529a1153 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.550288 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce18e20-6600-4e60-916c-41b7529a1153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.550586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce18e20-6600-4e60-916c-41b7529a1153 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.551314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce18e20-6600-4e60-916c-41b7529a1153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:02.551619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce18e20-6600-4e60-916c-41b7529a1153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:02.553181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce18e20-6600-4e60-916c-41b7529a1153 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:02.576333 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 348/715] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:02.583223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d22946-712a-40b1-885b-5239b4565cf1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:02.595331 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d22946-712a-40b1-885b-5239b4565cf1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.604333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821f939-de0b-47fc-ba7f-e7e48763aaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.605118 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821f939-de0b-47fc-ba7f-e7e48763aaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.605396 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821f939-de0b-47fc-ba7f-e7e48763aaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.605668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821f939-de0b-47fc-ba7f-e7e48763aaa4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.615595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821f939-de0b-47fc-ba7f-e7e48763aaa4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:02.617576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821f939-de0b-47fc-ba7f-e7e48763aaa4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:02.636520 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-a821f939-de0b-47fc-ba7f-e7e48763aaa4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:02.637884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 368/716] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:02.644554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce18e20-6600-4e60-916c-41b7529a1153 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:02.657900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce18e20-6600-4e60-916c-41b7529a1153 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.666382 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fadffc-ab0d-4040-8377-9985720c4e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.667040 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fadffc-ab0d-4040-8377-9985720c4e10 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.667369 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fadffc-ab0d-4040-8377-9985720c4e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.667652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fadffc-ab0d-4040-8377-9985720c4e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.668442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fadffc-ab0d-4040-8377-9985720c4e10 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:02.668743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fadffc-ab0d-4040-8377-9985720c4e10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:02.670576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fadffc-ab0d-4040-8377-9985720c4e10 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:02.687728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 349/717] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:02.694589 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821f939-de0b-47fc-ba7f-e7e48763aaa4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:02.705662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821f939-de0b-47fc-ba7f-e7e48763aaa4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:02.718559 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47effedb-790b-45d3-a3eb-1e86997ae8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:02.719223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47effedb-790b-45d3-a3eb-1e86997ae8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:02.720070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47effedb-790b-45d3-a3eb-1e86997ae8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:02.720557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47effedb-790b-45d3-a3eb-1e86997ae8a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:02.721522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47effedb-790b-45d3-a3eb-1e86997ae8a9 admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=f2a17190105a4228bdd94926e1a2091e) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:02.721840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47effedb-790b-45d3-a3eb-1e86997ae8a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:02.723699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47effedb-790b-45d3-a3eb-1e86997ae8a9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:02.730076 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 369/718] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:02 2021] GET /identity/v3/role_assignments?user.id=f2a17190105a4228bdd94926e1a2091e&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:03.333888 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b4dc3-17ba-42ef-9e50-c4bea59dc15d None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.334424 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b4dc3-17ba-42ef-9e50-c4bea59dc15d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.334534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b4dc3-17ba-42ef-9e50-c4bea59dc15d None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.336481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 350/719] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:03.341977 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fdf47-c571-4d9b-918e-5f7e232b5897 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.342408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fdf47-c571-4d9b-918e-5f7e232b5897 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.342626 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fdf47-c571-4d9b-918e-5f7e232b5897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.369328 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ab1fdf47-c571-4d9b-918e-5f7e232b5897 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:03.370577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ab1fdf47-c571-4d9b-918e-5f7e232b5897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:03.378988 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 370/720] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:57:03.403202 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b4dc3-17ba-42ef-9e50-c4bea59dc15d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:03.416098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b4dc3-17ba-42ef-9e50-c4bea59dc15d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:03.420492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc630d5a-00de-4a74-97e9-b5b3af6f4188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:03.421290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc630d5a-00de-4a74-97e9-b5b3af6f4188 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.421575 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc630d5a-00de-4a74-97e9-b5b3af6f4188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.421855 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc630d5a-00de-4a74-97e9-b5b3af6f4188 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.433519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc630d5a-00de-4a74-97e9-b5b3af6f4188 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:03.441498 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-cc630d5a-00de-4a74-97e9-b5b3af6f4188 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:57:03.446809 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 351/721] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:57:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:03.449753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fdf47-c571-4d9b-918e-5f7e232b5897 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:03.459524 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fdf47-c571-4d9b-918e-5f7e232b5897 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:03.464158 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb5a25-e1e2-4909-b3c2-7799cca13954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:03.464829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb5a25-e1e2-4909-b3c2-7799cca13954 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.465106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb5a25-e1e2-4909-b3c2-7799cca13954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.465448 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb5a25-e1e2-4909-b3c2-7799cca13954 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.466213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb5a25-e1e2-4909-b3c2-7799cca13954 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:03.466595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb5a25-e1e2-4909-b3c2-7799cca13954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:03.468258 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb5a25-e1e2-4909-b3c2-7799cca13954 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:03.480193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 371/722] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:57:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:03.486024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc630d5a-00de-4a74-97e9-b5b3af6f4188 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:03.498191 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc630d5a-00de-4a74-97e9-b5b3af6f4188 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:03.502832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a7b18-de39-4365-9fc8-844d5b977060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:03.503663 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a7b18-de39-4365-9fc8-844d5b977060 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.503994 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a7b18-de39-4365-9fc8-844d5b977060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.504268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a7b18-de39-4365-9fc8-844d5b977060 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.516582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a7b18-de39-4365-9fc8-844d5b977060 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:03.518521 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a7b18-de39-4365-9fc8-844d5b977060 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:03.538278 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-b70a7b18-de39-4365-9fc8-844d5b977060 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:03.544752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 352/723] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:03.546104 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb5a25-e1e2-4909-b3c2-7799cca13954 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:03.558034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb5a25-e1e2-4909-b3c2-7799cca13954 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:03.562745 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99553f39-5e21-470d-923f-49313f85040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:03.563438 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99553f39-5e21-470d-923f-49313f85040e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.563733 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99553f39-5e21-470d-923f-49313f85040e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.564025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99553f39-5e21-470d-923f-49313f85040e admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.564696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99553f39-5e21-470d-923f-49313f85040e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:03.565053 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99553f39-5e21-470d-923f-49313f85040e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:03.566750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99553f39-5e21-470d-923f-49313f85040e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:03.584803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 372/724] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:03.586069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a7b18-de39-4365-9fc8-844d5b977060 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:03.596243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a7b18-de39-4365-9fc8-844d5b977060 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:03.600887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf2bc9-99b7-4537-845a-d3cc81f608d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:03.601753 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf2bc9-99b7-4537-845a-d3cc81f608d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.602037 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf2bc9-99b7-4537-845a-d3cc81f608d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.602379 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf2bc9-99b7-4537-845a-d3cc81f608d1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.612156 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf2bc9-99b7-4537-845a-d3cc81f608d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:03.614351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf2bc9-99b7-4537-845a-d3cc81f608d1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:03.630455 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-2faf2bc9-99b7-4537-845a-d3cc81f608d1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 09 00:57:03.631666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 353/725] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Dec 9 00:57:03 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:03.644437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99553f39-5e21-470d-923f-49313f85040e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:03.656021 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99553f39-5e21-470d-923f-49313f85040e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:03.663623 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53f08d-691f-4faa-bf7d-cf0b1fed332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:03.664318 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53f08d-691f-4faa-bf7d-cf0b1fed332f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.664605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53f08d-691f-4faa-bf7d-cf0b1fed332f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.664887 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53f08d-691f-4faa-bf7d-cf0b1fed332f admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.665831 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53f08d-691f-4faa-bf7d-cf0b1fed332f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:03.666197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53f08d-691f-4faa-bf7d-cf0b1fed332f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:03.668258 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53f08d-691f-4faa-bf7d-cf0b1fed332f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:03.695122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 373/726] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Dec 9 00:57:03 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:03.700738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf2bc9-99b7-4537-845a-d3cc81f608d1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:03.712898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf2bc9-99b7-4537-845a-d3cc81f608d1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:03.717602 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f0b75-099d-4742-a259-4c80d08fc0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:03.718252 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f0b75-099d-4742-a259-4c80d08fc0df admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.718559 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f0b75-099d-4742-a259-4c80d08fc0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.718840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f0b75-099d-4742-a259-4c80d08fc0df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.730715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f0b75-099d-4742-a259-4c80d08fc0df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:03.732477 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f0b75-099d-4742-a259-4c80d08fc0df admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:03.743268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 354/727] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 00:57:03.752363 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53f08d-691f-4faa-bf7d-cf0b1fed332f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:03.763908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53f08d-691f-4faa-bf7d-cf0b1fed332f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:03.770527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b29354-5d00-428c-8c9b-cff7d79ee2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:03.771292 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29354-5d00-428c-8c9b-cff7d79ee2ba admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.771599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29354-5d00-428c-8c9b-cff7d79ee2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.771840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29354-5d00-428c-8c9b-cff7d79ee2ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.790159 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b29354-5d00-428c-8c9b-cff7d79ee2ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:03.792013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b29354-5d00-428c-8c9b-cff7d79ee2ba admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:03.817317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-71b29354-5d00-428c-8c9b-cff7d79ee2ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:03.818835 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 374/728] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:03.824706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f0b75-099d-4742-a259-4c80d08fc0df admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:03.839367 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f0b75-099d-4742-a259-4c80d08fc0df admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:03.854387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c685d-7817-4d5d-927b-150be1926451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:03.854387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c685d-7817-4d5d-927b-150be1926451 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.854387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c685d-7817-4d5d-927b-150be1926451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.854387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c685d-7817-4d5d-927b-150be1926451 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.855080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c685d-7817-4d5d-927b-150be1926451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:03.855080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c685d-7817-4d5d-927b-150be1926451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:03.856237 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c685d-7817-4d5d-927b-150be1926451 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:03.876217 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 355/729] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:03.881743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b29354-5d00-428c-8c9b-cff7d79ee2ba admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:03.896262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b29354-5d00-428c-8c9b-cff7d79ee2ba admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:03.905944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08edef-e480-4c39-be69-69ebaec2eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:03.906751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08edef-e480-4c39-be69-69ebaec2eca2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.907332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08edef-e480-4c39-be69-69ebaec2eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.908829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08edef-e480-4c39-be69-69ebaec2eca2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.919475 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08edef-e480-4c39-be69-69ebaec2eca2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:03.921406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08edef-e480-4c39-be69-69ebaec2eca2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:03.942298 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-5c08edef-e480-4c39-be69-69ebaec2eca2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:03.943503 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 375/730] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:03.949554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c685d-7817-4d5d-927b-150be1926451 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:03.963762 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c685d-7817-4d5d-927b-150be1926451 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:03.975956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fa052-5b4e-412d-a54d-88d1b8d5bbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:03.976625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fa052-5b4e-412d-a54d-88d1b8d5bbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:03.976912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fa052-5b4e-412d-a54d-88d1b8d5bbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:03.977193 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fa052-5b4e-412d-a54d-88d1b8d5bbd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:03.977991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fa052-5b4e-412d-a54d-88d1b8d5bbd0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:03.978304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fa052-5b4e-412d-a54d-88d1b8d5bbd0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:03.980162 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fa052-5b4e-412d-a54d-88d1b8d5bbd0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:03.993502 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 356/731] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:03.999364 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08edef-e480-4c39-be69-69ebaec2eca2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:04.015122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08edef-e480-4c39-be69-69ebaec2eca2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:04.021846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e00fe-ffb8-4a62-9a59-c49a0d7f932a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:04.022504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e00fe-ffb8-4a62-9a59-c49a0d7f932a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.022785 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e00fe-ffb8-4a62-9a59-c49a0d7f932a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.023057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e00fe-ffb8-4a62-9a59-c49a0d7f932a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.023886 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e00fe-ffb8-4a62-9a59-c49a0d7f932a admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=7ccda27976ad40f2a62a50189f0fdc63) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:04.024193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e00fe-ffb8-4a62-9a59-c49a0d7f932a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:04.026000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e00fe-ffb8-4a62-9a59-c49a0d7f932a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:04.031666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 376/732] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:03 2021] GET /identity/v3/role_assignments?user.id=7ccda27976ad40f2a62a50189f0fdc63&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:04.274547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093a1ad-c132-4967-a8df-1f7450f1ee69 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.274547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093a1ad-c132-4967-a8df-1f7450f1ee69 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.274547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093a1ad-c132-4967-a8df-1f7450f1ee69 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.275521 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 357/733] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:04.282069 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a2721-865d-4cc0-880d-f9ab23341c81 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.282586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a2721-865d-4cc0-880d-f9ab23341c81 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.282849 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a2721-865d-4cc0-880d-f9ab23341c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.311447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9e0a2721-865d-4cc0-880d-f9ab23341c81 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:04.312679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9e0a2721-865d-4cc0-880d-f9ab23341c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:04.320846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 377/734] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 09 00:57:04.345789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093a1ad-c132-4967-a8df-1f7450f1ee69 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:04.359002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093a1ad-c132-4967-a8df-1f7450f1ee69 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:04.364460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812a6a4-a115-4ec7-8e80-8bceebd4aa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:04.365241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812a6a4-a115-4ec7-8e80-8bceebd4aa09 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.365524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812a6a4-a115-4ec7-8e80-8bceebd4aa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.365799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812a6a4-a115-4ec7-8e80-8bceebd4aa09 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.378586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812a6a4-a115-4ec7-8e80-8bceebd4aa09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:04.386403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-a812a6a4-a115-4ec7-8e80-8bceebd4aa09 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:57:04.388033 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 358/735] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:04.395157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a2721-865d-4cc0-880d-f9ab23341c81 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:04.404211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a2721-865d-4cc0-880d-f9ab23341c81 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:04.409899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb1f73-3c80-449f-a2a6-15149c3b5fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:04.410601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb1f73-3c80-449f-a2a6-15149c3b5fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.410886 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb1f73-3c80-449f-a2a6-15149c3b5fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.411158 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb1f73-3c80-449f-a2a6-15149c3b5fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.411925 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb1f73-3c80-449f-a2a6-15149c3b5fdb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:04.412228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb1f73-3c80-449f-a2a6-15149c3b5fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:04.413820 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb1f73-3c80-449f-a2a6-15149c3b5fdb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:04.423428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 378/736] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:57:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:04.429393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812a6a4-a115-4ec7-8e80-8bceebd4aa09 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:04.443937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812a6a4-a115-4ec7-8e80-8bceebd4aa09 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:04.451103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4404737-d402-4b94-8140-d3e9dc4a810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:04.451896 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4404737-d402-4b94-8140-d3e9dc4a810b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.452181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4404737-d402-4b94-8140-d3e9dc4a810b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.452459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4404737-d402-4b94-8140-d3e9dc4a810b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.470320 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4404737-d402-4b94-8140-d3e9dc4a810b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:04.472168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4404737-d402-4b94-8140-d3e9dc4a810b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:04.497971 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-b4404737-d402-4b94-8140-d3e9dc4a810b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:04.499469 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 359/737] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:04.505923 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb1f73-3c80-449f-a2a6-15149c3b5fdb admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:04.516145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb1f73-3c80-449f-a2a6-15149c3b5fdb admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:04.524175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f0362-8938-4660-afd9-5f97c42f9ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:04.525376 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f0362-8938-4660-afd9-5f97c42f9ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.525674 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f0362-8938-4660-afd9-5f97c42f9ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.525957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f0362-8938-4660-afd9-5f97c42f9ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.526733 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f0362-8938-4660-afd9-5f97c42f9ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:04.527039 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f0362-8938-4660-afd9-5f97c42f9ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:04.528643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f0362-8938-4660-afd9-5f97c42f9ec0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:04.541878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 379/738] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:04.548292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4404737-d402-4b94-8140-d3e9dc4a810b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:04.558136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4404737-d402-4b94-8140-d3e9dc4a810b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:04.562626 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2e03b-4d63-42b5-b8cf-2072a15a9f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:04.563553 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2e03b-4d63-42b5-b8cf-2072a15a9f0b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.564050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2e03b-4d63-42b5-b8cf-2072a15a9f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.564335 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2e03b-4d63-42b5-b8cf-2072a15a9f0b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.572499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2e03b-4d63-42b5-b8cf-2072a15a9f0b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:04.574541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2e03b-4d63-42b5-b8cf-2072a15a9f0b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:04.588929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-74a2e03b-4d63-42b5-b8cf-2072a15a9f0b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 09 00:57:04.590403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 360/739] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Dec 9 00:57:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:04.596772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f0362-8938-4660-afd9-5f97c42f9ec0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:04.606630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f0362-8938-4660-afd9-5f97c42f9ec0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:04.612504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf347e6-96bf-42ac-8868-fcd82b3fd5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:04.613173 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf347e6-96bf-42ac-8868-fcd82b3fd5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.613451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf347e6-96bf-42ac-8868-fcd82b3fd5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.613727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf347e6-96bf-42ac-8868-fcd82b3fd5a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.614602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf347e6-96bf-42ac-8868-fcd82b3fd5a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:04.614913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf347e6-96bf-42ac-8868-fcd82b3fd5a6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:04.616756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf347e6-96bf-42ac-8868-fcd82b3fd5a6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:04.638536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 380/740] 10.222.0.23 () {56 vars in 1154 bytes} [Thu Dec 9 00:57:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:04.655452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2e03b-4d63-42b5-b8cf-2072a15a9f0b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:04.669868 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2e03b-4d63-42b5-b8cf-2072a15a9f0b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:04.679016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1cfc1-3742-4394-84ed-f0b6eb848c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:04.679899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1cfc1-3742-4394-84ed-f0b6eb848c2d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.680261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1cfc1-3742-4394-84ed-f0b6eb848c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.680614 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1cfc1-3742-4394-84ed-f0b6eb848c2d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.692991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1cfc1-3742-4394-84ed-f0b6eb848c2d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:04.694973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1cfc1-3742-4394-84ed-f0b6eb848c2d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:04.715454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-87d1cfc1-3742-4394-84ed-f0b6eb848c2d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:04.717048 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 361/741] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:04.724063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf347e6-96bf-42ac-8868-fcd82b3fd5a6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:04.735579 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf347e6-96bf-42ac-8868-fcd82b3fd5a6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:04.746596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd5de0-fa79-41ff-89a9-3564e8376fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:04.747358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd5de0-fa79-41ff-89a9-3564e8376fec admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.747717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd5de0-fa79-41ff-89a9-3564e8376fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.748068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd5de0-fa79-41ff-89a9-3564e8376fec admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.748887 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd5de0-fa79-41ff-89a9-3564e8376fec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:04.749270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd5de0-fa79-41ff-89a9-3564e8376fec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:04.751757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd5de0-fa79-41ff-89a9-3564e8376fec admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:04.766216 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 381/742] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:04.772997 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1cfc1-3742-4394-84ed-f0b6eb848c2d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:04.788061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1cfc1-3742-4394-84ed-f0b6eb848c2d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:04.797127 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cdcc6-8b83-471d-b32f-572ca8ce7219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:04.798143 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cdcc6-8b83-471d-b32f-572ca8ce7219 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.798500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cdcc6-8b83-471d-b32f-572ca8ce7219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.798782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cdcc6-8b83-471d-b32f-572ca8ce7219 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.811903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cdcc6-8b83-471d-b32f-572ca8ce7219 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:04.814453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cdcc6-8b83-471d-b32f-572ca8ce7219 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:04.834194 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-891cdcc6-8b83-471d-b32f-572ca8ce7219 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:04.835426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 362/743] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:04.846629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd5de0-fa79-41ff-89a9-3564e8376fec admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:04.865742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd5de0-fa79-41ff-89a9-3564e8376fec admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:04.874065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b8427-c17c-4aed-ba98-9a8ec081d4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:04.874787 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b8427-c17c-4aed-ba98-9a8ec081d4df admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.875077 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b8427-c17c-4aed-ba98-9a8ec081d4df admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.875360 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b8427-c17c-4aed-ba98-9a8ec081d4df admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.876947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b8427-c17c-4aed-ba98-9a8ec081d4df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:04.877270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b8427-c17c-4aed-ba98-9a8ec081d4df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:04.879233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b8427-c17c-4aed-ba98-9a8ec081d4df admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:04.898387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 382/744] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:04.904771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cdcc6-8b83-471d-b32f-572ca8ce7219 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:04.919548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cdcc6-8b83-471d-b32f-572ca8ce7219 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:04.929583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e29e5-21ce-49f3-a9be-a90b8ffdf2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:04.930548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e29e5-21ce-49f3-a9be-a90b8ffdf2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.930877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e29e5-21ce-49f3-a9be-a90b8ffdf2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.931149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e29e5-21ce-49f3-a9be-a90b8ffdf2c4 admin admin] PATH_INFO: `/v3/projects/0566d367619740a48d8dca2def78a386/users/53d32ba063bc4a719d4c2f67d88ec640/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.935708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e29e5-21ce-49f3-a9be-a90b8ffdf2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566d367619740a48d8dca2def78a386, user_id=53d32ba063bc4a719d4c2f67d88ec640, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:04.938600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e29e5-21ce-49f3-a9be-a90b8ffdf2c4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:04.951582 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085c2a8-b893-4d27-b1ab-dfeb9347334c None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.951869 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085c2a8-b893-4d27-b1ab-dfeb9347334c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.952122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085c2a8-b893-4d27-b1ab-dfeb9347334c None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.956125 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 383/745] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:04.961758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0c163-b03d-4b92-8e3b-cf24c3fc8a43 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:04.962044 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0c163-b03d-4b92-8e3b-cf24c3fc8a43 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:04.962322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0c163-b03d-4b92-8e3b-cf24c3fc8a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:04.964307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 363/746] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:57:04 2021] PUT /identity/v3/projects/0566d367619740a48d8dca2def78a386/users/53d32ba063bc4a719d4c2f67d88ec640/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:57:04.986335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-b3d0c163-b03d-4b92-8e3b-cf24c3fc8a43 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:04.987878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b3d0c163-b03d-4b92-8e3b-cf24c3fc8a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:05.051933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 384/747] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 09 00:57:05.091960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e29e5-21ce-49f3-a9be-a90b8ffdf2c4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:05.103285 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e29e5-21ce-49f3-a9be-a90b8ffdf2c4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:05.108219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc7a5a-498b-4084-940f-e1be50bd9247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:05.108940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc7a5a-498b-4084-940f-e1be50bd9247 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:05.109219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc7a5a-498b-4084-940f-e1be50bd9247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:05.109491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc7a5a-498b-4084-940f-e1be50bd9247 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:05.110413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc7a5a-498b-4084-940f-e1be50bd9247 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:05.111519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-3dbc7a5a-498b-4084-940f-e1be50bd9247 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:57:05.111519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:57:05.111519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:57:05.112673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc7a5a-498b-4084-940f-e1be50bd9247 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:05.131033 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 364/748] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:57:05 2021] POST /identity/v3/services => generated 251 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 00:57:05.332659 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c253e-ae9a-4d37-8624-fc13f02fe6e4 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:05.333120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c253e-ae9a-4d37-8624-fc13f02fe6e4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:05.333507 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c253e-ae9a-4d37-8624-fc13f02fe6e4 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:05.335819 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 385/749] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:05.342425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2dbf0a-2947-46b7-993d-560e53a8c250 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:05.342720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2dbf0a-2947-46b7-993d-560e53a8c250 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:05.342980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2dbf0a-2947-46b7-993d-560e53a8c250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:05.367420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-5e2dbf0a-2947-46b7-993d-560e53a8c250 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:05.368652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5e2dbf0a-2947-46b7-993d-560e53a8c250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:05.391791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 365/750] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:05 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:05.416227 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c253e-ae9a-4d37-8624-fc13f02fe6e4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:05.431084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c253e-ae9a-4d37-8624-fc13f02fe6e4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:05.435831 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c43f06-9807-4dde-99ef-2d0a26a94f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:05.436760 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c43f06-9807-4dde-99ef-2d0a26a94f00 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:05.437256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c43f06-9807-4dde-99ef-2d0a26a94f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:05.437947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c43f06-9807-4dde-99ef-2d0a26a94f00 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:05.439377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c43f06-9807-4dde-99ef-2d0a26a94f00 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:05.440891 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-68c43f06-9807-4dde-99ef-2d0a26a94f00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:57:05.440891 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:57:05.440891 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:57:05.442254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c43f06-9807-4dde-99ef-2d0a26a94f00 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:05.462458 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 386/751] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:57:05 2021] POST /identity/v3/services => generated 240 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 00:57:06.423567 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d650e4-4d8d-4330-9de2-c29d40bd7125 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:06.424098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d650e4-4d8d-4330-9de2-c29d40bd7125 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:06.424098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d650e4-4d8d-4330-9de2-c29d40bd7125 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:06.426187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 366/752] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:06.432018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6465d82-538c-444a-9193-7d5032fa66d8 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:06.432985 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6465d82-538c-444a-9193-7d5032fa66d8 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:06.433491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6465d82-538c-444a-9193-7d5032fa66d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:06.459366 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a6465d82-538c-444a-9193-7d5032fa66d8 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:06.460939 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a6465d82-538c-444a-9193-7d5032fa66d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:06.494438 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 387/753] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:06 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:06.531496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d650e4-4d8d-4330-9de2-c29d40bd7125 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:06.552526 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d650e4-4d8d-4330-9de2-c29d40bd7125 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:06.562469 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb528f-30c5-41fb-96a8-de38bbcc5fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:06.563324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb528f-30c5-41fb-96a8-de38bbcc5fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:06.564225 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb528f-30c5-41fb-96a8-de38bbcc5fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:06.564506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb528f-30c5-41fb-96a8-de38bbcc5fd4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:06.586123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb528f-30c5-41fb-96a8-de38bbcc5fd4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:06.592966 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-21bb528f-30c5-41fb-96a8-de38bbcc5fd4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:57:06.594415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 367/754] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:06.600778 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6465d82-538c-444a-9193-7d5032fa66d8 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:06.610878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6465d82-538c-444a-9193-7d5032fa66d8 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:06.621789 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba819e6-4e41-4437-9b95-212f13157688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:06.622772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba819e6-4e41-4437-9b95-212f13157688 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:06.623266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba819e6-4e41-4437-9b95-212f13157688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:06.623762 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba819e6-4e41-4437-9b95-212f13157688 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:06.624729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba819e6-4e41-4437-9b95-212f13157688 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:06.625330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba819e6-4e41-4437-9b95-212f13157688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:06.627269 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba819e6-4e41-4437-9b95-212f13157688 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:06.643529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 388/755] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:57:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:06.649618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb528f-30c5-41fb-96a8-de38bbcc5fd4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:06.664338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb528f-30c5-41fb-96a8-de38bbcc5fd4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:06.680081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aebfaf-4fd7-4c26-954d-03775b0ff083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:06.680813 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aebfaf-4fd7-4c26-954d-03775b0ff083 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:06.681098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aebfaf-4fd7-4c26-954d-03775b0ff083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:06.681374 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aebfaf-4fd7-4c26-954d-03775b0ff083 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:06.701981 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aebfaf-4fd7-4c26-954d-03775b0ff083 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:06.704467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aebfaf-4fd7-4c26-954d-03775b0ff083 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:06.732591 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-59aebfaf-4fd7-4c26-954d-03775b0ff083 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:06.734102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 368/756] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:06.741135 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba819e6-4e41-4437-9b95-212f13157688 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:06.755827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba819e6-4e41-4437-9b95-212f13157688 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:06.760901 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38914aa3-81da-43f7-b336-5597cd8bf055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:06.761845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38914aa3-81da-43f7-b336-5597cd8bf055 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:06.762405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38914aa3-81da-43f7-b336-5597cd8bf055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:06.762893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38914aa3-81da-43f7-b336-5597cd8bf055 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:06.763850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38914aa3-81da-43f7-b336-5597cd8bf055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:06.764419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38914aa3-81da-43f7-b336-5597cd8bf055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:06.766852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38914aa3-81da-43f7-b336-5597cd8bf055 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:06.780179 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 389/757] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:06.787774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aebfaf-4fd7-4c26-954d-03775b0ff083 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:06.803849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aebfaf-4fd7-4c26-954d-03775b0ff083 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:06.819008 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447d67-b089-45fd-a31a-cf55d2e092a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:06.819810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447d67-b089-45fd-a31a-cf55d2e092a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:06.820091 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447d67-b089-45fd-a31a-cf55d2e092a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:06.820360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447d67-b089-45fd-a31a-cf55d2e092a2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:06.831437 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32447d67-b089-45fd-a31a-cf55d2e092a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:06.833438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32447d67-b089-45fd-a31a-cf55d2e092a2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:06.851337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-32447d67-b089-45fd-a31a-cf55d2e092a2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 09 00:57:06.852846 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 369/758] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:06 2021] GET /identity/v3/users/swift => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:06.858597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38914aa3-81da-43f7-b336-5597cd8bf055 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:06.874402 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38914aa3-81da-43f7-b336-5597cd8bf055 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:06.882016 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5691f0-a70d-441c-ba5b-71dab8495ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:06.883004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5691f0-a70d-441c-ba5b-71dab8495ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:06.883496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5691f0-a70d-441c-ba5b-71dab8495ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:06.884030 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5691f0-a70d-441c-ba5b-71dab8495ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:06.885154 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5691f0-a70d-441c-ba5b-71dab8495ed4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:06.885671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5691f0-a70d-441c-ba5b-71dab8495ed4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:06.887816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5691f0-a70d-441c-ba5b-71dab8495ed4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:06.909083 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 390/759] 10.222.0.23 () {56 vars in 1156 bytes} [Thu Dec 9 00:57:06 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:06.914816 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447d67-b089-45fd-a31a-cf55d2e092a2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:06.931384 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447d67-b089-45fd-a31a-cf55d2e092a2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:06.943533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb057cf-54b7-4393-8466-291c1cef5a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:06.944178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb057cf-54b7-4393-8466-291c1cef5a08 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:06.944458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb057cf-54b7-4393-8466-291c1cef5a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:06.944732 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb057cf-54b7-4393-8466-291c1cef5a08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:06.966042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb057cf-54b7-4393-8466-291c1cef5a08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:06.967823 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb057cf-54b7-4393-8466-291c1cef5a08 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:06.979760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 370/760] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:06 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:57:06.986286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5691f0-a70d-441c-ba5b-71dab8495ed4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:06.999629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5691f0-a70d-441c-ba5b-71dab8495ed4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.010097 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8d955-e4e9-4242-b387-04f90b15fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.011300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8d955-e4e9-4242-b387-04f90b15fe34 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.011817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8d955-e4e9-4242-b387-04f90b15fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.012329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8d955-e4e9-4242-b387-04f90b15fe34 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.034890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8d955-e4e9-4242-b387-04f90b15fe34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.036739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8d955-e4e9-4242-b387-04f90b15fe34 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.061004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-84f8d955-e4e9-4242-b387-04f90b15fe34 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:07.062571 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 391/761] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:07.069344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb057cf-54b7-4393-8466-291c1cef5a08 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.077806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e70fb-0879-4025-bb88-934176e34f8a None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.078087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e70fb-0879-4025-bb88-934176e34f8a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.078404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e70fb-0879-4025-bb88-934176e34f8a None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.080698 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 392/762] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:57:07.084781 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb057cf-54b7-4393-8466-291c1cef5a08 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.086686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9924bb-a60a-4c27-ac1d-ac9ef1919c8f None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.086927 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9924bb-a60a-4c27-ac1d-ac9ef1919c8f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.087198 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9924bb-a60a-4c27-ac1d-ac9ef1919c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.089444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a04be0-afcd-42a2-968c-ae50c0d058d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.090095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04be0-afcd-42a2-968c-ae50c0d058d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.090393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04be0-afcd-42a2-968c-ae50c0d058d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.090682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04be0-afcd-42a2-968c-ae50c0d058d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.091419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a04be0-afcd-42a2-968c-ae50c0d058d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:07.091725 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a04be0-afcd-42a2-968c-ae50c0d058d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.093312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a04be0-afcd-42a2-968c-ae50c0d058d4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.108011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 371/763] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:07.117807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a04be0-afcd-42a2-968c-ae50c0d058d4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.120662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-cd9924bb-a60a-4c27-ac1d-ac9ef1919c8f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:07.121871 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cd9924bb-a60a-4c27-ac1d-ac9ef1919c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:07.130008 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a04be0-afcd-42a2-968c-ae50c0d058d4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.139626 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf66af-1e3f-4fa2-b3bc-e7afe78674cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.140877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf66af-1e3f-4fa2-b3bc-e7afe78674cb admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.141228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf66af-1e3f-4fa2-b3bc-e7afe78674cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.142704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf66af-1e3f-4fa2-b3bc-e7afe78674cb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.144932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 393/764] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:07 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:07.152677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf66af-1e3f-4fa2-b3bc-e7afe78674cb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.154706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf66af-1e3f-4fa2-b3bc-e7afe78674cb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.168808 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-0abf66af-1e3f-4fa2-b3bc-e7afe78674cb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:07.170284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 372/765] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:07.179566 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9924bb-a60a-4c27-ac1d-ac9ef1919c8f None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.181969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf66af-1e3f-4fa2-b3bc-e7afe78674cb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.195141 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9924bb-a60a-4c27-ac1d-ac9ef1919c8f None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.204860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf66af-1e3f-4fa2-b3bc-e7afe78674cb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.206143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37b05-8ab5-4e68-a887-d016b5b933a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.206849 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37b05-8ab5-4e68-a887-d016b5b933a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.207126 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37b05-8ab5-4e68-a887-d016b5b933a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.207397 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37b05-8ab5-4e68-a887-d016b5b933a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.208196 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37b05-8ab5-4e68-a887-d016b5b933a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:07.208500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37b05-8ab5-4e68-a887-d016b5b933a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.210338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37b05-8ab5-4e68-a887-d016b5b933a3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.222762 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82ae9b-d7bf-42a3-abaf-ed0b6e00859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.223552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82ae9b-d7bf-42a3-abaf-ed0b6e00859c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.223829 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82ae9b-d7bf-42a3-abaf-ed0b6e00859c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.224098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82ae9b-d7bf-42a3-abaf-ed0b6e00859c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.232050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 394/766] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:07.238495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37b05-8ab5-4e68-a887-d016b5b933a3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.243948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82ae9b-d7bf-42a3-abaf-ed0b6e00859c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:07.251448 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-5c82ae9b-d7bf-42a3-abaf-ed0b6e00859c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:57:07.252640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 373/767] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:07.258688 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82ae9b-d7bf-42a3-abaf-ed0b6e00859c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.265472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37b05-8ab5-4e68-a887-d016b5b933a3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.268450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82ae9b-d7bf-42a3-abaf-ed0b6e00859c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.275171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d2430-0c21-48f2-b6ad-8ecba0095733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.275823 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d2430-0c21-48f2-b6ad-8ecba0095733 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.276481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d2430-0c21-48f2-b6ad-8ecba0095733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.276761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d2430-0c21-48f2-b6ad-8ecba0095733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.278089 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d2430-0c21-48f2-b6ad-8ecba0095733 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:07.278991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870fcfd-ef22-4524-92ca-97705f24a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.279742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870fcfd-ef22-4524-92ca-97705f24a614 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.280022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870fcfd-ef22-4524-92ca-97705f24a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.280296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870fcfd-ef22-4524-92ca-97705f24a614 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.280778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d2430-0c21-48f2-b6ad-8ecba0095733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.282892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870fcfd-ef22-4524-92ca-97705f24a614 admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=f2a17190105a4228bdd94926e1a2091e) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:07.283237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870fcfd-ef22-4524-92ca-97705f24a614 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.284333 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d2430-0c21-48f2-b6ad-8ecba0095733 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.286676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870fcfd-ef22-4524-92ca-97705f24a614 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.306471 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 395/768] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/role_assignments?user.id=f2a17190105a4228bdd94926e1a2091e&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 259 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:07.306791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 374/769] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:07.312700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870fcfd-ef22-4524-92ca-97705f24a614 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.327994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870fcfd-ef22-4524-92ca-97705f24a614 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.337345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92964c-1e33-4137-b9d6-8ec505cdb87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.338163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92964c-1e33-4137-b9d6-8ec505cdb87a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.338470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92964c-1e33-4137-b9d6-8ec505cdb87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.338750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92964c-1e33-4137-b9d6-8ec505cdb87a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.358697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92964c-1e33-4137-b9d6-8ec505cdb87a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.361109 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92964c-1e33-4137-b9d6-8ec505cdb87a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.389179 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-8e92964c-1e33-4137-b9d6-8ec505cdb87a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:07.390798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 396/770] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:07.397537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d2430-0c21-48f2-b6ad-8ecba0095733 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.408226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d2430-0c21-48f2-b6ad-8ecba0095733 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.413116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0bcae-ac5e-4784-a6d2-beb4e3b1b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.413807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0bcae-ac5e-4784-a6d2-beb4e3b1b5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.414092 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0bcae-ac5e-4784-a6d2-beb4e3b1b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.414397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0bcae-ac5e-4784-a6d2-beb4e3b1b5a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.415174 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0bcae-ac5e-4784-a6d2-beb4e3b1b5a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:07.415484 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0bcae-ac5e-4784-a6d2-beb4e3b1b5a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.417128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0bcae-ac5e-4784-a6d2-beb4e3b1b5a5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.430992 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 375/771] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:07.437225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92964c-1e33-4137-b9d6-8ec505cdb87a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.448501 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92964c-1e33-4137-b9d6-8ec505cdb87a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.453540 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10432363-e5bb-45f5-aed8-7c9ec35e4309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.454985 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10432363-e5bb-45f5-aed8-7c9ec35e4309 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.455315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10432363-e5bb-45f5-aed8-7c9ec35e4309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.455596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10432363-e5bb-45f5-aed8-7c9ec35e4309 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.464868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10432363-e5bb-45f5-aed8-7c9ec35e4309 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.467053 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10432363-e5bb-45f5-aed8-7c9ec35e4309 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.482258 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-10432363-e5bb-45f5-aed8-7c9ec35e4309 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 09 00:57:07.483915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 397/772] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:07.491085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0bcae-ac5e-4784-a6d2-beb4e3b1b5a5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.502198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0bcae-ac5e-4784-a6d2-beb4e3b1b5a5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.507283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53e8ed-37af-439e-804e-1db96d357a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.507968 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53e8ed-37af-439e-804e-1db96d357a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.508298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53e8ed-37af-439e-804e-1db96d357a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.508574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53e8ed-37af-439e-804e-1db96d357a0b admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.509489 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53e8ed-37af-439e-804e-1db96d357a0b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:07.509799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53e8ed-37af-439e-804e-1db96d357a0b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.511797 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53e8ed-37af-439e-804e-1db96d357a0b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.532712 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 376/773] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:07.538809 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10432363-e5bb-45f5-aed8-7c9ec35e4309 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.549502 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10432363-e5bb-45f5-aed8-7c9ec35e4309 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.554273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940dd05-212a-4932-babf-bd77adb6a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.555144 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940dd05-212a-4932-babf-bd77adb6a37e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.555428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940dd05-212a-4932-babf-bd77adb6a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.555707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940dd05-212a-4932-babf-bd77adb6a37e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.568400 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940dd05-212a-4932-babf-bd77adb6a37e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.570328 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940dd05-212a-4932-babf-bd77adb6a37e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.589062 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-b940dd05-212a-4932-babf-bd77adb6a37e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:07.590638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 398/774] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:07.597877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53e8ed-37af-439e-804e-1db96d357a0b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.609002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53e8ed-37af-439e-804e-1db96d357a0b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.614635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e292b-662a-4e86-964a-03fc8b23af4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.615296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e292b-662a-4e86-964a-03fc8b23af4a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.615640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e292b-662a-4e86-964a-03fc8b23af4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.615920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e292b-662a-4e86-964a-03fc8b23af4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.616658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e292b-662a-4e86-964a-03fc8b23af4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:07.617013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e292b-662a-4e86-964a-03fc8b23af4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.618709 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e292b-662a-4e86-964a-03fc8b23af4a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.631049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 377/775] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:07.637129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940dd05-212a-4932-babf-bd77adb6a37e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.648064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940dd05-212a-4932-babf-bd77adb6a37e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.652853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9d354-9b0c-42fd-ab61-92031647e34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.653685 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d354-9b0c-42fd-ab61-92031647e34d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.653972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d354-9b0c-42fd-ab61-92031647e34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.654247 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d354-9b0c-42fd-ab61-92031647e34d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.661581 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9d354-9b0c-42fd-ab61-92031647e34d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.663640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9d354-9b0c-42fd-ab61-92031647e34d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.677933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-67b9d354-9b0c-42fd-ab61-92031647e34d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:07.679472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 399/776] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:07.685638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e292b-662a-4e86-964a-03fc8b23af4a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.697428 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e292b-662a-4e86-964a-03fc8b23af4a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.702104 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb3542-8d02-4a36-aade-7d1fa7aeb9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.702795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3542-8d02-4a36-aade-7d1fa7aeb9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.703248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3542-8d02-4a36-aade-7d1fa7aeb9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.703533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3542-8d02-4a36-aade-7d1fa7aeb9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.704594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb3542-8d02-4a36-aade-7d1fa7aeb9d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:07.704907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb3542-8d02-4a36-aade-7d1fa7aeb9d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.706846 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb3542-8d02-4a36-aade-7d1fa7aeb9d7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.720686 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 378/777] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:07.726980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9d354-9b0c-42fd-ab61-92031647e34d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.737585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9d354-9b0c-42fd-ab61-92031647e34d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:07.742423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5624a59-9884-41a4-b31f-29367e845869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:07.743367 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5624a59-9884-41a4-b31f-29367e845869 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.743647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5624a59-9884-41a4-b31f-29367e845869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.743973 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5624a59-9884-41a4-b31f-29367e845869 admin admin] PATH_INFO: `/v3/projects/0566d367619740a48d8dca2def78a386/users/7ccda27976ad40f2a62a50189f0fdc63/roles/0de5bfc441494559af3a8cdd798c347e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.760811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5624a59-9884-41a4-b31f-29367e845869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566d367619740a48d8dca2def78a386, user_id=7ccda27976ad40f2a62a50189f0fdc63, role_id=0de5bfc441494559af3a8cdd798c347e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:07.763500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5624a59-9884-41a4-b31f-29367e845869 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:07.779036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 400/778] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:57:07 2021] PUT /identity/v3/projects/0566d367619740a48d8dca2def78a386/users/7ccda27976ad40f2a62a50189f0fdc63/roles/0de5bfc441494559af3a8cdd798c347e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 00:57:07.843358 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae404a2-6c01-4106-adb1-b640c1d9ede3 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.843686 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae404a2-6c01-4106-adb1-b640c1d9ede3 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.843875 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae404a2-6c01-4106-adb1-b640c1d9ede3 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.847106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 379/779] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:07.853536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a23f7-dae9-473e-8c3b-4ed8cee91718 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:07.853831 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a23f7-dae9-473e-8c3b-4ed8cee91718 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:07.854085 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a23f7-dae9-473e-8c3b-4ed8cee91718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:07.874556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-247a23f7-dae9-473e-8c3b-4ed8cee91718 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:07.875973 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-247a23f7-dae9-473e-8c3b-4ed8cee91718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:07.958205 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 401/780] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:07 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:07.983931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae404a2-6c01-4106-adb1-b640c1d9ede3 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:07.997415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae404a2-6c01-4106-adb1-b640c1d9ede3 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.002329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b5f80-c1d1-4727-b124-e7519d140cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.003156 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5f80-c1d1-4727-b124-e7519d140cae admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.003432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5f80-c1d1-4727-b124-e7519d140cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.003760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5f80-c1d1-4727-b124-e7519d140cae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.019939 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b5f80-c1d1-4727-b124-e7519d140cae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:08.027238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-936b5f80-c1d1-4727-b124-e7519d140cae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:57:08.030466 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 380/781] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:08.035635 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a23f7-dae9-473e-8c3b-4ed8cee91718 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.044725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a23f7-dae9-473e-8c3b-4ed8cee91718 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.050013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d13cc-7c09-4659-b5f5-b2be99a27d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.050725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d13cc-7c09-4659-b5f5-b2be99a27d2b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.051004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d13cc-7c09-4659-b5f5-b2be99a27d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.051277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d13cc-7c09-4659-b5f5-b2be99a27d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.052040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d13cc-7c09-4659-b5f5-b2be99a27d2b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:08.052343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d13cc-7c09-4659-b5f5-b2be99a27d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.053958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d13cc-7c09-4659-b5f5-b2be99a27d2b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.063304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 402/782] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:08.069611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b5f80-c1d1-4727-b124-e7519d140cae admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.080779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b5f80-c1d1-4727-b124-e7519d140cae admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.085429 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02d470-ca91-496d-9636-d552ddefb8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.086587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02d470-ca91-496d-9636-d552ddefb8ab admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.086873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02d470-ca91-496d-9636-d552ddefb8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.087176 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02d470-ca91-496d-9636-d552ddefb8ab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.099976 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02d470-ca91-496d-9636-d552ddefb8ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.101847 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02d470-ca91-496d-9636-d552ddefb8ab admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.120421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-ee02d470-ca91-496d-9636-d552ddefb8ab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:08.126490 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 381/783] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:08.128272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d13cc-7c09-4659-b5f5-b2be99a27d2b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.138428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d13cc-7c09-4659-b5f5-b2be99a27d2b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.144134 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a91cbe-677e-4a17-a609-f6cc586f7958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.144840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a91cbe-677e-4a17-a609-f6cc586f7958 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.145118 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a91cbe-677e-4a17-a609-f6cc586f7958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.145387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a91cbe-677e-4a17-a609-f6cc586f7958 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.146167 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a91cbe-677e-4a17-a609-f6cc586f7958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:08.146513 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a91cbe-677e-4a17-a609-f6cc586f7958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.148148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a91cbe-677e-4a17-a609-f6cc586f7958 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.162851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 403/784] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:08.168982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02d470-ca91-496d-9636-d552ddefb8ab admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.179707 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02d470-ca91-496d-9636-d552ddefb8ab admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.184393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1f8a0-2c5e-44b8-944b-9bebd33df470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.185213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1f8a0-2c5e-44b8-944b-9bebd33df470 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.185498 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1f8a0-2c5e-44b8-944b-9bebd33df470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.185895 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1f8a0-2c5e-44b8-944b-9bebd33df470 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.195044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1f8a0-2c5e-44b8-944b-9bebd33df470 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.197197 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1f8a0-2c5e-44b8-944b-9bebd33df470 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.211820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-0ea1f8a0-2c5e-44b8-944b-9bebd33df470 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 09 00:57:08.217973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 382/785] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:08.219938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a91cbe-677e-4a17-a609-f6cc586f7958 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.230561 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a91cbe-677e-4a17-a609-f6cc586f7958 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.235267 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063bd5a-a26a-4390-80d0-015304f5370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.235979 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063bd5a-a26a-4390-80d0-015304f5370d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.236258 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063bd5a-a26a-4390-80d0-015304f5370d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.236792 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063bd5a-a26a-4390-80d0-015304f5370d admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.237691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063bd5a-a26a-4390-80d0-015304f5370d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:08.237996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063bd5a-a26a-4390-80d0-015304f5370d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.239989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063bd5a-a26a-4390-80d0-015304f5370d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.261580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 404/786] 10.222.0.23 () {56 vars in 1154 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:08.265261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1f8a0-2c5e-44b8-944b-9bebd33df470 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.276034 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1f8a0-2c5e-44b8-944b-9bebd33df470 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.284050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149667d-5fd8-4fcd-9774-b566b4bf0210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.284689 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149667d-5fd8-4fcd-9774-b566b4bf0210 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.284957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149667d-5fd8-4fcd-9774-b566b4bf0210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.285285 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149667d-5fd8-4fcd-9774-b566b4bf0210 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.295890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149667d-5fd8-4fcd-9774-b566b4bf0210 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.298452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149667d-5fd8-4fcd-9774-b566b4bf0210 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.315137 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 383/787] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:57:08.321830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063bd5a-a26a-4390-80d0-015304f5370d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.333809 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063bd5a-a26a-4390-80d0-015304f5370d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.338692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822273ae-ac9c-4321-84a9-178c11422b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.339608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822273ae-ac9c-4321-84a9-178c11422b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.339959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822273ae-ac9c-4321-84a9-178c11422b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.341737 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822273ae-ac9c-4321-84a9-178c11422b91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.343429 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a73ba-0ffd-4247-a62c-a9003a828fa5 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.343429 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a73ba-0ffd-4247-a62c-a9003a828fa5 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.343429 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a73ba-0ffd-4247-a62c-a9003a828fa5 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.349197 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 384/788] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:57:08.352326 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7cbc4-4e29-4120-9402-b97c99fe7441 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.352542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7cbc4-4e29-4120-9402-b97c99fe7441 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.352823 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7cbc4-4e29-4120-9402-b97c99fe7441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.353829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822273ae-ac9c-4321-84a9-178c11422b91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.356237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822273ae-ac9c-4321-84a9-178c11422b91 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.389517 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-09a7cbc4-4e29-4120-9402-b97c99fe7441 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:08.390744 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-09a7cbc4-4e29-4120-9402-b97c99fe7441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:08.397600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-822273ae-ac9c-4321-84a9-178c11422b91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:08.404770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 405/789] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:08.406519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822273ae-ac9c-4321-84a9-178c11422b91 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.413727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 385/790] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:08 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:08.427600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822273ae-ac9c-4321-84a9-178c11422b91 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.432742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382d079-79b0-4b7e-8450-a944670c6515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.433398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382d079-79b0-4b7e-8450-a944670c6515 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.433717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382d079-79b0-4b7e-8450-a944670c6515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.433989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382d079-79b0-4b7e-8450-a944670c6515 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.434813 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382d079-79b0-4b7e-8450-a944670c6515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:08.435113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382d079-79b0-4b7e-8450-a944670c6515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.436844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382d079-79b0-4b7e-8450-a944670c6515 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.454833 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 406/791] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:08.460909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7cbc4-4e29-4120-9402-b97c99fe7441 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.471574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7cbc4-4e29-4120-9402-b97c99fe7441 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.476096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68482d-e19a-44df-be22-aa7d339c083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.476924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68482d-e19a-44df-be22-aa7d339c083a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.477233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68482d-e19a-44df-be22-aa7d339c083a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.477517 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68482d-e19a-44df-be22-aa7d339c083a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.484316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382d079-79b0-4b7e-8450-a944670c6515 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.487810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68482d-e19a-44df-be22-aa7d339c083a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.490005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68482d-e19a-44df-be22-aa7d339c083a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.504127 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-0b68482d-e19a-44df-be22-aa7d339c083a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:08.505852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382d079-79b0-4b7e-8450-a944670c6515 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.506238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 386/792] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:08.514452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68482d-e19a-44df-be22-aa7d339c083a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.524201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6f1d0-e85e-4d64-b183-e1046c8cea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.525248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6f1d0-e85e-4d64-b183-e1046c8cea8f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.526348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6f1d0-e85e-4d64-b183-e1046c8cea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.526787 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6f1d0-e85e-4d64-b183-e1046c8cea8f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.528120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6f1d0-e85e-4d64-b183-e1046c8cea8f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.531295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6f1d0-e85e-4d64-b183-e1046c8cea8f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.540030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68482d-e19a-44df-be22-aa7d339c083a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.550313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71944fd-d8fb-4ea9-81fa-614012ee5f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.551172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71944fd-d8fb-4ea9-81fa-614012ee5f02 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.553092 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71944fd-d8fb-4ea9-81fa-614012ee5f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.553508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71944fd-d8fb-4ea9-81fa-614012ee5f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.556088 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71944fd-d8fb-4ea9-81fa-614012ee5f02 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:08.556540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71944fd-d8fb-4ea9-81fa-614012ee5f02 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.559667 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-82d6f1d0-e85e-4d64-b183-e1046c8cea8f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 09 00:57:08.561394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71944fd-d8fb-4ea9-81fa-614012ee5f02 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.563144 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 407/793] 10.222.0.23 () {56 vars in 1150 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:08.568755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6f1d0-e85e-4d64-b183-e1046c8cea8f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.581986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6f1d0-e85e-4d64-b183-e1046c8cea8f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.586945 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 387/794] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:08.595181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71944fd-d8fb-4ea9-81fa-614012ee5f02 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.603078 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff2c21-7c5d-4d41-af3d-542120c0e3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.603756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff2c21-7c5d-4d41-af3d-542120c0e3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.604050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff2c21-7c5d-4d41-af3d-542120c0e3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.604334 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff2c21-7c5d-4d41-af3d-542120c0e3a0 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.605065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff2c21-7c5d-4d41-af3d-542120c0e3a0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:08.605376 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71944fd-d8fb-4ea9-81fa-614012ee5f02 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.605492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff2c21-7c5d-4d41-af3d-542120c0e3a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.607029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff2c21-7c5d-4d41-af3d-542120c0e3a0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.610340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a3bd0-0589-4219-8940-b1b3db990382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.611085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3bd0-0589-4219-8940-b1b3db990382 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.611369 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3bd0-0589-4219-8940-b1b3db990382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.611906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3bd0-0589-4219-8940-b1b3db990382 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.612793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a3bd0-0589-4219-8940-b1b3db990382 admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=53d32ba063bc4a719d4c2f67d88ec640) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:08.613194 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a3bd0-0589-4219-8940-b1b3db990382 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.615081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a3bd0-0589-4219-8940-b1b3db990382 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.619193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 408/795] 10.222.0.23 () {56 vars in 1145 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:08.621974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 388/796] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/role_assignments?user.id=53d32ba063bc4a719d4c2f67d88ec640&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:08.627439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff2c21-7c5d-4d41-af3d-542120c0e3a0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.637655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff2c21-7c5d-4d41-af3d-542120c0e3a0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.644163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398713b-0c74-4fed-b43a-88a6744ecbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.644868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398713b-0c74-4fed-b43a-88a6744ecbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.645149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398713b-0c74-4fed-b43a-88a6744ecbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.645425 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398713b-0c74-4fed-b43a-88a6744ecbe6 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.646187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398713b-0c74-4fed-b43a-88a6744ecbe6 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:08.646525 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398713b-0c74-4fed-b43a-88a6744ecbe6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.648263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398713b-0c74-4fed-b43a-88a6744ecbe6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.661208 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 409/797] 10.222.0.23 () {56 vars in 1145 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:08.667167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a3bd0-0589-4219-8940-b1b3db990382 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.677990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a3bd0-0589-4219-8940-b1b3db990382 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.684452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2e56a-5f88-4197-b7aa-a1e3e6bbc7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.685114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2e56a-5f88-4197-b7aa-a1e3e6bbc7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.685446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2e56a-5f88-4197-b7aa-a1e3e6bbc7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.685721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2e56a-5f88-4197-b7aa-a1e3e6bbc7b6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.686650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2e56a-5f88-4197-b7aa-a1e3e6bbc7b6 admin admin] RBAC: Adding query filter params (interface=public, service_id=6e73d8a59f6f44e19cae9ca1d8902431, region_id=RegionOne) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:08.686961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2e56a-5f88-4197-b7aa-a1e3e6bbc7b6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.688573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-a2f2e56a-5f88-4197-b7aa-a1e3e6bbc7b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:57:08.688573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:57:08.688573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:57:08.689799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2e56a-5f88-4197-b7aa-a1e3e6bbc7b6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.703651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 389/798] 10.222.0.23 () {56 vars in 1272 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/endpoints?service_id=6e73d8a59f6f44e19cae9ca1d8902431&interface=public®ion_id=RegionOne => generated 194 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:08.710624 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398713b-0c74-4fed-b43a-88a6744ecbe6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.720909 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398713b-0c74-4fed-b43a-88a6744ecbe6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.725807 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0bdde-1f9b-400a-a1dc-4fcefddbdf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.726494 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0bdde-1f9b-400a-a1dc-4fcefddbdf0f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.726771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0bdde-1f9b-400a-a1dc-4fcefddbdf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.727049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0bdde-1f9b-400a-a1dc-4fcefddbdf0f admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.727801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0bdde-1f9b-400a-a1dc-4fcefddbdf0f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.729649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0bdde-1f9b-400a-a1dc-4fcefddbdf0f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.736388 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 410/799] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/services => generated 772 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:08.775024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc887f-d48e-4522-b4f3-33b6cc3d5b3d None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.775024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc887f-d48e-4522-b4f3-33b6cc3d5b3d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.775024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc887f-d48e-4522-b4f3-33b6cc3d5b3d None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.775659 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 390/800] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:08.784550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5516c-feb2-43b8-97d5-6ef3d0f3c4e1 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.784550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5516c-feb2-43b8-97d5-6ef3d0f3c4e1 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.784550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5516c-feb2-43b8-97d5-6ef3d0f3c4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.802682 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ece5516c-feb2-43b8-97d5-6ef3d0f3c4e1 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:08.804192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ece5516c-feb2-43b8-97d5-6ef3d0f3c4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:08.812949 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 411/801] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:08 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:08.838537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc887f-d48e-4522-b4f3-33b6cc3d5b3d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.863893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc887f-d48e-4522-b4f3-33b6cc3d5b3d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.869104 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74194d70-8cf8-4f68-9937-bd2371c920eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.870296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74194d70-8cf8-4f68-9937-bd2371c920eb admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.870778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74194d70-8cf8-4f68-9937-bd2371c920eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.871294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74194d70-8cf8-4f68-9937-bd2371c920eb admin admin] PATH_INFO: `/v3/services/network` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.872155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74194d70-8cf8-4f68-9937-bd2371c920eb admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.874046 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74194d70-8cf8-4f68-9937-bd2371c920eb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.886715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-74194d70-8cf8-4f68-9937-bd2371c920eb admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 09 00:57:08.888584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 391/802] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/services/network => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:08.895981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5516c-feb2-43b8-97d5-6ef3d0f3c4e1 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.910653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5516c-feb2-43b8-97d5-6ef3d0f3c4e1 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.919616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7880dc-dc53-4247-8dad-f1224dfd09b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.920558 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7880dc-dc53-4247-8dad-f1224dfd09b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.920992 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7880dc-dc53-4247-8dad-f1224dfd09b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.921443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7880dc-dc53-4247-8dad-f1224dfd09b4 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.922938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7880dc-dc53-4247-8dad-f1224dfd09b4 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:08.923419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7880dc-dc53-4247-8dad-f1224dfd09b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.925393 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7880dc-dc53-4247-8dad-f1224dfd09b4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.936310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 412/803] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/services?name=network => generated 124 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:08.943191 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74194d70-8cf8-4f68-9937-bd2371c920eb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.957928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74194d70-8cf8-4f68-9937-bd2371c920eb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:08.966055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227505b-4565-4d6a-86b5-1ab1621523c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:08.967101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227505b-4565-4d6a-86b5-1ab1621523c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:08.967549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227505b-4565-4d6a-86b5-1ab1621523c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:08.968074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227505b-4565-4d6a-86b5-1ab1621523c5 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:08.969014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227505b-4565-4d6a-86b5-1ab1621523c5 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:08.970231 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227505b-4565-4d6a-86b5-1ab1621523c5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:08.972296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227505b-4565-4d6a-86b5-1ab1621523c5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:08.980958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 392/804] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/services?type=network => generated 350 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:08.988342 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7880dc-dc53-4247-8dad-f1224dfd09b4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:08.999562 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7880dc-dc53-4247-8dad-f1224dfd09b4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:09.004830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f544f9-01a4-49b1-8f9f-3edb78d26f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:09.005801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f544f9-01a4-49b1-8f9f-3edb78d26f0a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:09.006258 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f544f9-01a4-49b1-8f9f-3edb78d26f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:09.006714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f544f9-01a4-49b1-8f9f-3edb78d26f0a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:09.007750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f544f9-01a4-49b1-8f9f-3edb78d26f0a admin admin] RBAC: Adding query filter params (interface=public, service_id=74b012bd033c4a7780e65156a2f892bc, region_id=RegionOne) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:09.008273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f544f9-01a4-49b1-8f9f-3edb78d26f0a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:09.009492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-b0f544f9-01a4-49b1-8f9f-3edb78d26f0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:57:09.009492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:57:09.009492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:57:09.010795 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f544f9-01a4-49b1-8f9f-3edb78d26f0a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:09.020776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 413/805] 10.222.0.23 () {56 vars in 1272 bytes} [Thu Dec 9 00:57:08 2021] GET /identity/v3/endpoints?service_id=74b012bd033c4a7780e65156a2f892bc&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:09.027219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227505b-4565-4d6a-86b5-1ab1621523c5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:09.038701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227505b-4565-4d6a-86b5-1ab1621523c5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:09.045537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153bca2-70b3-426b-882d-3f2498804754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:09.046569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153bca2-70b3-426b-882d-3f2498804754 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:09.047002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153bca2-70b3-426b-882d-3f2498804754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:09.047502 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153bca2-70b3-426b-882d-3f2498804754 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:09.048510 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153bca2-70b3-426b-882d-3f2498804754 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:09.050476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153bca2-70b3-426b-882d-3f2498804754 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:09.056961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 393/806] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Dec 9 00:57:09 2021] GET /identity/v3/services => generated 772 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:10.417133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb79092-1f6a-4426-a81d-822169cbee86 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.418189 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb79092-1f6a-4426-a81d-822169cbee86 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.418714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb79092-1f6a-4426-a81d-822169cbee86 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.421147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 414/807] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:10.428242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cb5f7-34b4-4f49-889b-8a5e5d33ade6 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.429223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cb5f7-34b4-4f49-889b-8a5e5d33ade6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.429713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cb5f7-34b4-4f49-889b-8a5e5d33ade6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.452850 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e05cb5f7-34b4-4f49-889b-8a5e5d33ade6 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:10.455190 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e05cb5f7-34b4-4f49-889b-8a5e5d33ade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:10.468356 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 394/808] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:10 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:10.493359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb79092-1f6a-4426-a81d-822169cbee86 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:10.512333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb79092-1f6a-4426-a81d-822169cbee86 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:10.519219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b89dd-756f-43b2-bf58-27f67d54ff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:10.520313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b89dd-756f-43b2-bf58-27f67d54ff02 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.520820 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b89dd-756f-43b2-bf58-27f67d54ff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.521300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b89dd-756f-43b2-bf58-27f67d54ff02 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.537724 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b89dd-756f-43b2-bf58-27f67d54ff02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:10.544934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-f19b89dd-756f-43b2-bf58-27f67d54ff02 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:57:10.550697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 415/809] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:10.553923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cb5f7-34b4-4f49-889b-8a5e5d33ade6 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:10.563888 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cb5f7-34b4-4f49-889b-8a5e5d33ade6 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:10.575930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed19e0d-2e3c-4dd5-b677-d95848687962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:10.576908 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed19e0d-2e3c-4dd5-b677-d95848687962 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.577405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed19e0d-2e3c-4dd5-b677-d95848687962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.577937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed19e0d-2e3c-4dd5-b677-d95848687962 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.579013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed19e0d-2e3c-4dd5-b677-d95848687962 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:10.579542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed19e0d-2e3c-4dd5-b677-d95848687962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:10.581449 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed19e0d-2e3c-4dd5-b677-d95848687962 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:10.593790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 395/810] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:57:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:10.600195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b89dd-756f-43b2-bf58-27f67d54ff02 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:10.613091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b89dd-756f-43b2-bf58-27f67d54ff02 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:10.618038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e3547-838f-4828-acc3-757047c715d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:10.619190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e3547-838f-4828-acc3-757047c715d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.619694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e3547-838f-4828-acc3-757047c715d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.620175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e3547-838f-4828-acc3-757047c715d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.636899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e3547-838f-4828-acc3-757047c715d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:10.639077 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e3547-838f-4828-acc3-757047c715d3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:10.659373 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-481e3547-838f-4828-acc3-757047c715d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:10.661222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 416/811] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:10.667524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed19e0d-2e3c-4dd5-b677-d95848687962 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:10.677468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed19e0d-2e3c-4dd5-b677-d95848687962 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:10.686472 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95326c33-6521-4651-b2d1-70698bb74cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:10.687397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95326c33-6521-4651-b2d1-70698bb74cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.688411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95326c33-6521-4651-b2d1-70698bb74cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.689077 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95326c33-6521-4651-b2d1-70698bb74cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.690023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95326c33-6521-4651-b2d1-70698bb74cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:10.690583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95326c33-6521-4651-b2d1-70698bb74cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:10.692424 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95326c33-6521-4651-b2d1-70698bb74cb7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:10.709379 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 396/812] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:10.715634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e3547-838f-4828-acc3-757047c715d3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:10.727351 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e3547-838f-4828-acc3-757047c715d3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:10.733489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e1a8a-c96a-4440-bb45-70a3a89ff04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:10.734322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e1a8a-c96a-4440-bb45-70a3a89ff04d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.734626 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e1a8a-c96a-4440-bb45-70a3a89ff04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.734932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e1a8a-c96a-4440-bb45-70a3a89ff04d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.749159 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e1a8a-c96a-4440-bb45-70a3a89ff04d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:10.751972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e1a8a-c96a-4440-bb45-70a3a89ff04d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:10.772437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-d60e1a8a-c96a-4440-bb45-70a3a89ff04d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 09 00:57:10.773962 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 417/813] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:10 2021] GET /identity/v3/users/swift => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:10.780126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95326c33-6521-4651-b2d1-70698bb74cb7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:10.800476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95326c33-6521-4651-b2d1-70698bb74cb7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:10.810547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f78f84-d2ff-4da5-9048-3a6d67f181e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:10.811503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78f84-d2ff-4da5-9048-3a6d67f181e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.812000 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78f84-d2ff-4da5-9048-3a6d67f181e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.812495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78f84-d2ff-4da5-9048-3a6d67f181e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.814294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78f84-d2ff-4da5-9048-3a6d67f181e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:10.814846 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78f84-d2ff-4da5-9048-3a6d67f181e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:10.816922 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78f84-d2ff-4da5-9048-3a6d67f181e2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:10.835558 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb59b7-ceaf-4156-8b11-76a95e707e8c None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.835860 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb59b7-ceaf-4156-8b11-76a95e707e8c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.836308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb59b7-ceaf-4156-8b11-76a95e707e8c None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.838960 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 418/814] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:57:10.853098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 397/815] 10.222.0.23 () {56 vars in 1156 bytes} [Thu Dec 9 00:57:10 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:10.853273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e4a17-ecdb-4980-9899-e813a190805d None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.853273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e4a17-ecdb-4980-9899-e813a190805d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.853273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e4a17-ecdb-4980-9899-e813a190805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.854591 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f78f84-d2ff-4da5-9048-3a6d67f181e2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:10.868014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f78f84-d2ff-4da5-9048-3a6d67f181e2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:10.872876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f072b3-d720-4fc8-bc00-008f73ef1ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:10.873903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f072b3-d720-4fc8-bc00-008f73ef1ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.874455 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f072b3-d720-4fc8-bc00-008f73ef1ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.874948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f072b3-d720-4fc8-bc00-008f73ef1ad5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.887665 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-106e4a17-ecdb-4980-9899-e813a190805d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:10.889169 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-106e4a17-ecdb-4980-9899-e813a190805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:10.895362 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f072b3-d720-4fc8-bc00-008f73ef1ad5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:10.897443 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f072b3-d720-4fc8-bc00-008f73ef1ad5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:10.911784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 419/816] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:10 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:10.922296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-56f072b3-d720-4fc8-bc00-008f73ef1ad5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:10.924576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 398/817] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:10.930715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e4a17-ecdb-4980-9899-e813a190805d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:10.941024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e4a17-ecdb-4980-9899-e813a190805d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:10.945779 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569ef85-2142-49cf-9e95-45169fa0b917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:10.946723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569ef85-2142-49cf-9e95-45169fa0b917 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.947219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569ef85-2142-49cf-9e95-45169fa0b917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.947706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569ef85-2142-49cf-9e95-45169fa0b917 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.948643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569ef85-2142-49cf-9e95-45169fa0b917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:10.949158 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569ef85-2142-49cf-9e95-45169fa0b917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:10.950993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569ef85-2142-49cf-9e95-45169fa0b917 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:10.955636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f072b3-d720-4fc8-bc00-008f73ef1ad5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:10.968387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f072b3-d720-4fc8-bc00-008f73ef1ad5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:10.977620 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ab9f3-fa75-4ee1-be0d-97da3bf73c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:10.979098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ab9f3-fa75-4ee1-be0d-97da3bf73c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:10.981155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ab9f3-fa75-4ee1-be0d-97da3bf73c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:10.981649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ab9f3-fa75-4ee1-be0d-97da3bf73c42 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:10.982845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 420/818] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:10.994957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569ef85-2142-49cf-9e95-45169fa0b917 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.003440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ab9f3-fa75-4ee1-be0d-97da3bf73c42 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:11.006194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569ef85-2142-49cf-9e95-45169fa0b917 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.015267 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba117b-d678-4244-8966-bee7cff4a4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.017497 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba117b-d678-4244-8966-bee7cff4a4ec admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.018056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba117b-d678-4244-8966-bee7cff4a4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.018706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba117b-d678-4244-8966-bee7cff4a4ec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.022803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-021ab9f3-fa75-4ee1-be0d-97da3bf73c42 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:57:11.024335 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 399/819] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:57:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:11.029232 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba117b-d678-4244-8966-bee7cff4a4ec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.030633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ab9f3-fa75-4ee1-be0d-97da3bf73c42 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.031512 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba117b-d678-4244-8966-bee7cff4a4ec admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.050411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ab9f3-fa75-4ee1-be0d-97da3bf73c42 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.050591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-8fba117b-d678-4244-8966-bee7cff4a4ec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:11.050591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 421/820] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:11.053998 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba117b-d678-4244-8966-bee7cff4a4ec admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.060865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a526e-40e8-4d27-b06c-5146a159e56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.061751 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a526e-40e8-4d27-b06c-5146a159e56a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.062168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a526e-40e8-4d27-b06c-5146a159e56a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.063144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a526e-40e8-4d27-b06c-5146a159e56a admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.065230 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a526e-40e8-4d27-b06c-5146a159e56a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:11.066777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a526e-40e8-4d27-b06c-5146a159e56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.068574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a526e-40e8-4d27-b06c-5146a159e56a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.072456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba117b-d678-4244-8966-bee7cff4a4ec admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.082208 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cee52-f104-4682-a90b-0e9a295a46e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.083176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cee52-f104-4682-a90b-0e9a295a46e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.083868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cee52-f104-4682-a90b-0e9a295a46e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.084497 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cee52-f104-4682-a90b-0e9a295a46e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.087490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cee52-f104-4682-a90b-0e9a295a46e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:11.088004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cee52-f104-4682-a90b-0e9a295a46e6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.089277 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 400/821] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:11.090620 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cee52-f104-4682-a90b-0e9a295a46e6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.093197 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a526e-40e8-4d27-b06c-5146a159e56a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.108050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a526e-40e8-4d27-b06c-5146a159e56a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.111277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 422/822] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:11.117900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cee52-f104-4682-a90b-0e9a295a46e6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.121885 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884bda7-a3c8-4e77-9099-a0aba786050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.122889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884bda7-a3c8-4e77-9099-a0aba786050e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.123534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884bda7-a3c8-4e77-9099-a0aba786050e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.125622 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884bda7-a3c8-4e77-9099-a0aba786050e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.136627 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cee52-f104-4682-a90b-0e9a295a46e6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.146990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884bda7-a3c8-4e77-9099-a0aba786050e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.147218 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12af8-4260-43d3-a393-dc27d2d59ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.149681 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12af8-4260-43d3-a393-dc27d2d59ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.150202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12af8-4260-43d3-a393-dc27d2d59ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.150708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12af8-4260-43d3-a393-dc27d2d59ff2 admin admin] PATH_INFO: `/v3/projects/0566d367619740a48d8dca2def78a386/users/f2a17190105a4228bdd94926e1a2091e/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.151447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884bda7-a3c8-4e77-9099-a0aba786050e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.154776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a12af8-4260-43d3-a393-dc27d2d59ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566d367619740a48d8dca2def78a386, user_id=f2a17190105a4228bdd94926e1a2091e, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.159686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a12af8-4260-43d3-a393-dc27d2d59ff2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.183782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 423/823] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:57:11 2021] PUT /identity/v3/projects/0566d367619740a48d8dca2def78a386/users/f2a17190105a4228bdd94926e1a2091e/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:57:11.189847 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-f884bda7-a3c8-4e77-9099-a0aba786050e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:11.191974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 401/824] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:11.199762 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12af8-4260-43d3-a393-dc27d2d59ff2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.276470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12af8-4260-43d3-a393-dc27d2d59ff2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.282441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45007d4-30e8-4f4b-9c68-b38361b42304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.283464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45007d4-30e8-4f4b-9c68-b38361b42304 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.283919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45007d4-30e8-4f4b-9c68-b38361b42304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.284365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45007d4-30e8-4f4b-9c68-b38361b42304 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.285299 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45007d4-30e8-4f4b-9c68-b38361b42304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:11.285788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45007d4-30e8-4f4b-9c68-b38361b42304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.287646 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45007d4-30e8-4f4b-9c68-b38361b42304 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.302212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 424/825] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:11.311724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884bda7-a3c8-4e77-9099-a0aba786050e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.322949 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884bda7-a3c8-4e77-9099-a0aba786050e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.334530 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2411d-94dd-44c1-8440-533a3d38387e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.335721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2411d-94dd-44c1-8440-533a3d38387e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.336210 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2411d-94dd-44c1-8440-533a3d38387e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.336656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2411d-94dd-44c1-8440-533a3d38387e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.346704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2411d-94dd-44c1-8440-533a3d38387e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.349157 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2411d-94dd-44c1-8440-533a3d38387e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.379536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-fbe2411d-94dd-44c1-8440-533a3d38387e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 09 00:57:11.386072 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 402/826] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:11.391812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45007d4-30e8-4f4b-9c68-b38361b42304 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.408168 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45007d4-30e8-4f4b-9c68-b38361b42304 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.417753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0288059-8a6a-4cc2-97fd-0a4e6767543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.419257 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288059-8a6a-4cc2-97fd-0a4e6767543e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.419754 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288059-8a6a-4cc2-97fd-0a4e6767543e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.420233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288059-8a6a-4cc2-97fd-0a4e6767543e admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.421270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0288059-8a6a-4cc2-97fd-0a4e6767543e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:11.421792 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0288059-8a6a-4cc2-97fd-0a4e6767543e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.424595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0288059-8a6a-4cc2-97fd-0a4e6767543e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.453118 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 425/827] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:11.459293 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2411d-94dd-44c1-8440-533a3d38387e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.473304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2411d-94dd-44c1-8440-533a3d38387e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.478640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828979-2c97-4bd2-9d2d-0345b2b90f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.479299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828979-2c97-4bd2-9d2d-0345b2b90f9b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.479574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828979-2c97-4bd2-9d2d-0345b2b90f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.479840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828979-2c97-4bd2-9d2d-0345b2b90f9b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.491362 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0828979-2c97-4bd2-9d2d-0345b2b90f9b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.493110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0828979-2c97-4bd2-9d2d-0345b2b90f9b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.503209 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 403/828] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:57:11.508885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0288059-8a6a-4cc2-97fd-0a4e6767543e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.519367 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0288059-8a6a-4cc2-97fd-0a4e6767543e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.523990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce7ef2-d3c9-41c1-b8e5-0301618183b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.524829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce7ef2-d3c9-41c1-b8e5-0301618183b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.525106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce7ef2-d3c9-41c1-b8e5-0301618183b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.525432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce7ef2-d3c9-41c1-b8e5-0301618183b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.537245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce7ef2-d3c9-41c1-b8e5-0301618183b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.539402 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce7ef2-d3c9-41c1-b8e5-0301618183b1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.559025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-46ce7ef2-d3c9-41c1-b8e5-0301618183b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:11.560608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 426/829] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:11.566554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828979-2c97-4bd2-9d2d-0345b2b90f9b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.582100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828979-2c97-4bd2-9d2d-0345b2b90f9b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.601110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484f7aa-35cd-469a-bc59-132a4ab145b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.601878 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484f7aa-35cd-469a-bc59-132a4ab145b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.602259 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484f7aa-35cd-469a-bc59-132a4ab145b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.602630 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484f7aa-35cd-469a-bc59-132a4ab145b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.603450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484f7aa-35cd-469a-bc59-132a4ab145b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:11.603766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484f7aa-35cd-469a-bc59-132a4ab145b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.605354 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484f7aa-35cd-469a-bc59-132a4ab145b1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.623475 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 404/830] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:11.629381 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce7ef2-d3c9-41c1-b8e5-0301618183b1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.642817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce7ef2-d3c9-41c1-b8e5-0301618183b1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.650163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c74f32-ac98-4615-abea-d44fcf74ed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.651010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c74f32-ac98-4615-abea-d44fcf74ed7f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.651300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c74f32-ac98-4615-abea-d44fcf74ed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.651603 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c74f32-ac98-4615-abea-d44fcf74ed7f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.663619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c74f32-ac98-4615-abea-d44fcf74ed7f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.665760 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c74f32-ac98-4615-abea-d44fcf74ed7f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.684886 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-c2c74f32-ac98-4615-abea-d44fcf74ed7f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:11.686088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 427/831] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:11.693105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484f7aa-35cd-469a-bc59-132a4ab145b1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.708559 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484f7aa-35cd-469a-bc59-132a4ab145b1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.718985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca02b-7e0b-44fa-9210-56fd49ea0b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.719694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca02b-7e0b-44fa-9210-56fd49ea0b6c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.719980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca02b-7e0b-44fa-9210-56fd49ea0b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.720360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca02b-7e0b-44fa-9210-56fd49ea0b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.721172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cca02b-7e0b-44fa-9210-56fd49ea0b6c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:11.721484 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cca02b-7e0b-44fa-9210-56fd49ea0b6c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.723375 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cca02b-7e0b-44fa-9210-56fd49ea0b6c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.745693 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 405/832] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:11.752813 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c74f32-ac98-4615-abea-d44fcf74ed7f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.767048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c74f32-ac98-4615-abea-d44fcf74ed7f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.774181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed984bfd-ee45-46a2-bcc8-23d6645f8fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.774917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed984bfd-ee45-46a2-bcc8-23d6645f8fed admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.775195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed984bfd-ee45-46a2-bcc8-23d6645f8fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.775468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed984bfd-ee45-46a2-bcc8-23d6645f8fed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.776365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed984bfd-ee45-46a2-bcc8-23d6645f8fed admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=7ccda27976ad40f2a62a50189f0fdc63) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:11.776674 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed984bfd-ee45-46a2-bcc8-23d6645f8fed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.778704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed984bfd-ee45-46a2-bcc8-23d6645f8fed admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.791443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 428/833] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/role_assignments?user.id=7ccda27976ad40f2a62a50189f0fdc63&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:11.818232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7ed45-a1b8-4f53-865b-f7fcfd36818e None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.818555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7ed45-a1b8-4f53-865b-f7fcfd36818e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.818831 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7ed45-a1b8-4f53-865b-f7fcfd36818e None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.820740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 406/834] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:11.832695 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b123981-dc6d-4b0b-987a-5b9b1abfd710 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.833210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b123981-dc6d-4b0b-987a-5b9b1abfd710 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.833625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b123981-dc6d-4b0b-987a-5b9b1abfd710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.866147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-1b123981-dc6d-4b0b-987a-5b9b1abfd710 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:11.867717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1b123981-dc6d-4b0b-987a-5b9b1abfd710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:11.882576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 429/835] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:11 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:11.919462 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0a0f2-7c52-4070-a345-4332f66c9ca1 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.919756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0a0f2-7c52-4070-a345-4332f66c9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.920046 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0a0f2-7c52-4070-a345-4332f66c9ca1 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.920938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b123981-dc6d-4b0b-987a-5b9b1abfd710 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:11.921926 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 407/836] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:11.930399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740106f0-e575-4bac-be57-271dd2828232 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.930399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740106f0-e575-4bac-be57-271dd2828232 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.930399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740106f0-e575-4bac-be57-271dd2828232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.937236 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b123981-dc6d-4b0b-987a-5b9b1abfd710 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:11.944739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eb5d0-9eef-4038-9775-de159ad471fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:11.945837 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb5d0-9eef-4038-9775-de159ad471fc admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:11.946107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb5d0-9eef-4038-9775-de159ad471fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:11.946468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb5d0-9eef-4038-9775-de159ad471fc admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:11.947190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eb5d0-9eef-4038-9775-de159ad471fc admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:11.948935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eb5d0-9eef-4038-9775-de159ad471fc admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:11.955727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-740106f0-e575-4bac-be57-271dd2828232 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:11.961296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-740106f0-e575-4bac-be57-271dd2828232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:11.976938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-615eb5d0-9eef-4038-9775-de159ad471fc admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 09 00:57:11.978948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 408/837] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:11 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:11.986160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 430/838] 10.222.0.23 () {56 vars in 1150 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:11.990005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740106f0-e575-4bac-be57-271dd2828232 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:12.006389 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740106f0-e575-4bac-be57-271dd2828232 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:12.015373 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747df89-c590-4b66-81be-193ccb00660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:12.016588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747df89-c590-4b66-81be-193ccb00660d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:12.017111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747df89-c590-4b66-81be-193ccb00660d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:12.017582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747df89-c590-4b66-81be-193ccb00660d admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:12.018671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747df89-c590-4b66-81be-193ccb00660d admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:12.019214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747df89-c590-4b66-81be-193ccb00660d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:12.021256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747df89-c590-4b66-81be-193ccb00660d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:12.028772 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 409/839] 10.222.0.23 () {56 vars in 1145 bytes} [Thu Dec 9 00:57:11 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:12.036333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eb5d0-9eef-4038-9775-de159ad471fc admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:12.048982 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eb5d0-9eef-4038-9775-de159ad471fc admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:12.049513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747df89-c590-4b66-81be-193ccb00660d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:12.056067 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c345cd-2210-45a0-b330-3c511a861f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:12.056609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c345cd-2210-45a0-b330-3c511a861f50 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:12.056888 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c345cd-2210-45a0-b330-3c511a861f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:12.057190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c345cd-2210-45a0-b330-3c511a861f50 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:12.057940 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c345cd-2210-45a0-b330-3c511a861f50 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:12.058251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c345cd-2210-45a0-b330-3c511a861f50 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:12.061080 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c345cd-2210-45a0-b330-3c511a861f50 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:12.063169 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747df89-c590-4b66-81be-193ccb00660d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:12.069967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 431/840] 10.222.0.23 () {56 vars in 1145 bytes} [Thu Dec 9 00:57:12 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:12.075058 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31611ca4-fa63-432a-82a1-710da9dfd9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:12.076222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31611ca4-fa63-432a-82a1-710da9dfd9fe admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:12.076705 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31611ca4-fa63-432a-82a1-710da9dfd9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:12.077203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31611ca4-fa63-432a-82a1-710da9dfd9fe admin admin] PATH_INFO: `/v3/services/network` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:12.078099 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31611ca4-fa63-432a-82a1-710da9dfd9fe admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:12.080551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31611ca4-fa63-432a-82a1-710da9dfd9fe admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:12.084294 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c345cd-2210-45a0-b330-3c511a861f50 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:12.095415 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c345cd-2210-45a0-b330-3c511a861f50 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:12.096663 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-31611ca4-fa63-432a-82a1-710da9dfd9fe admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 09 00:57:12.098145 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 410/841] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:12 2021] GET /identity/v3/services/network => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:12.104389 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31611ca4-fa63-432a-82a1-710da9dfd9fe admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:12.105307 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612736b6-6871-4abb-8517-0ace5de752ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:12.106232 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612736b6-6871-4abb-8517-0ace5de752ac admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:12.106728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612736b6-6871-4abb-8517-0ace5de752ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:12.107225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612736b6-6871-4abb-8517-0ace5de752ac admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:12.108241 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612736b6-6871-4abb-8517-0ace5de752ac admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:12.111045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-612736b6-6871-4abb-8517-0ace5de752ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:57:12.111045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:57:12.111045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:57:12.113326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612736b6-6871-4abb-8517-0ace5de752ac admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:12.115556 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31611ca4-fa63-432a-82a1-710da9dfd9fe admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:12.120260 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30517aec-c8d9-4257-bfa7-bd61f9c7ac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:12.120907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30517aec-c8d9-4257-bfa7-bd61f9c7ac53 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:12.121189 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30517aec-c8d9-4257-bfa7-bd61f9c7ac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:12.121471 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30517aec-c8d9-4257-bfa7-bd61f9c7ac53 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:12.122189 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30517aec-c8d9-4257-bfa7-bd61f9c7ac53 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:12.122562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30517aec-c8d9-4257-bfa7-bd61f9c7ac53 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:12.124158 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30517aec-c8d9-4257-bfa7-bd61f9c7ac53 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:12.131138 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 411/842] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:12 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:12.137767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30517aec-c8d9-4257-bfa7-bd61f9c7ac53 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:12.140900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 432/843] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Dec 9 00:57:12 2021] POST /identity/v3/endpoints => generated 346 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 00:57:12.152143 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30517aec-c8d9-4257-bfa7-bd61f9c7ac53 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:12.171215 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2496f2-4b0f-46ab-901f-59923dfe6dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:12.171893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2496f2-4b0f-46ab-901f-59923dfe6dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:12.172177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2496f2-4b0f-46ab-901f-59923dfe6dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:12.172486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2496f2-4b0f-46ab-901f-59923dfe6dc6 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:12.173394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2496f2-4b0f-46ab-901f-59923dfe6dc6 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:12.173709 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2496f2-4b0f-46ab-901f-59923dfe6dc6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:12.175440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2496f2-4b0f-46ab-901f-59923dfe6dc6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:12.181546 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 412/844] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:12 2021] GET /identity/v3/services?type=network => generated 350 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:12.188457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612736b6-6871-4abb-8517-0ace5de752ac admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:12.200906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612736b6-6871-4abb-8517-0ace5de752ac admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:12.206283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b214b-2e44-40c4-96bc-8f2b6162962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:12.207482 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b214b-2e44-40c4-96bc-8f2b6162962d admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:12.207972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b214b-2e44-40c4-96bc-8f2b6162962d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:12.208487 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b214b-2e44-40c4-96bc-8f2b6162962d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:12.209659 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b214b-2e44-40c4-96bc-8f2b6162962d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:12.211612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b214b-2e44-40c4-96bc-8f2b6162962d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:12.236345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 433/845] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Dec 9 00:57:12 2021] POST /identity/v3/endpoints => generated 327 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:12.281701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472be85-8ac7-4d0c-9eb0-730ba0517c6d None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:12.282726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472be85-8ac7-4d0c-9eb0-730ba0517c6d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:12.282726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472be85-8ac7-4d0c-9eb0-730ba0517c6d None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:12.284406 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 413/846] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:12.291644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5fe57-f639-4ec5-b21e-cd7a415ae696 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:12.292353 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5fe57-f639-4ec5-b21e-cd7a415ae696 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:12.292833 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5fe57-f639-4ec5-b21e-cd7a415ae696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:12.316808 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-96d5fe57-f639-4ec5-b21e-cd7a415ae696 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:12.318565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-96d5fe57-f639-4ec5-b21e-cd7a415ae696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:12.347022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 434/847] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:12 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:12.371224 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472be85-8ac7-4d0c-9eb0-730ba0517c6d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:12.388858 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472be85-8ac7-4d0c-9eb0-730ba0517c6d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:12.395742 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356f3f-4060-466a-8e7e-0f4e9ab6ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:12.396563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356f3f-4060-466a-8e7e-0f4e9ab6ecac admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:12.396842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356f3f-4060-466a-8e7e-0f4e9ab6ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:12.397110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356f3f-4060-466a-8e7e-0f4e9ab6ecac admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:12.397780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3356f3f-4060-466a-8e7e-0f4e9ab6ecac admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:12.399411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3356f3f-4060-466a-8e7e-0f4e9ab6ecac admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:12.413105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-c3356f3f-4060-466a-8e7e-0f4e9ab6ecac admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 09 00:57:12.414610 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 414/848] 10.222.0.23 () {56 vars in 1153 bytes} [Thu Dec 9 00:57:12 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:12.421681 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5fe57-f639-4ec5-b21e-cd7a415ae696 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:12.432679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5fe57-f639-4ec5-b21e-cd7a415ae696 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:12.444936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d54107-7da2-4b0b-b413-b3304019437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:12.445793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d54107-7da2-4b0b-b413-b3304019437e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:12.446175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d54107-7da2-4b0b-b413-b3304019437e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:12.446613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d54107-7da2-4b0b-b413-b3304019437e admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:12.448909 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d54107-7da2-4b0b-b413-b3304019437e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:12.449306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d54107-7da2-4b0b-b413-b3304019437e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:12.451122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d54107-7da2-4b0b-b413-b3304019437e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:12.461994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 435/849] 10.222.0.23 () {56 vars in 1147 bytes} [Thu Dec 9 00:57:12 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:12.468505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356f3f-4060-466a-8e7e-0f4e9ab6ecac admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:12.484404 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356f3f-4060-466a-8e7e-0f4e9ab6ecac admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:12.491120 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8c629-4dce-43c8-bc2e-ac6b517f891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:12.491795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8c629-4dce-43c8-bc2e-ac6b517f891c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:12.492078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8c629-4dce-43c8-bc2e-ac6b517f891c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:12.492351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8c629-4dce-43c8-bc2e-ac6b517f891c admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:12.493080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8c629-4dce-43c8-bc2e-ac6b517f891c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:12.493385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8c629-4dce-43c8-bc2e-ac6b517f891c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:12.495014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8c629-4dce-43c8-bc2e-ac6b517f891c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:12.507519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 415/850] 10.222.0.23 () {56 vars in 1147 bytes} [Thu Dec 9 00:57:12 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:13.911529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3a82d-1fe0-4d4e-8f77-c94d1304cf66 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:13.912387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3a82d-1fe0-4d4e-8f77-c94d1304cf66 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:13.912387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3a82d-1fe0-4d4e-8f77-c94d1304cf66 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:13.915592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 436/851] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:13 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:13.925781 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d07a93-0e45-42a1-aa11-37be1da99cc1 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:13.926391 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d07a93-0e45-42a1-aa11-37be1da99cc1 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:13.926812 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d07a93-0e45-42a1-aa11-37be1da99cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:13.950433 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-40d07a93-0e45-42a1-aa11-37be1da99cc1 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:13.951703 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-40d07a93-0e45-42a1-aa11-37be1da99cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:13.962212 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 416/852] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:13 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:13.993311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3a82d-1fe0-4d4e-8f77-c94d1304cf66 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.010191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3a82d-1fe0-4d4e-8f77-c94d1304cf66 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.016613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70299d-979b-4c1d-90b3-369627f4a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.018781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70299d-979b-4c1d-90b3-369627f4a65d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.019074 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70299d-979b-4c1d-90b3-369627f4a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.019355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70299d-979b-4c1d-90b3-369627f4a65d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.035913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70299d-979b-4c1d-90b3-369627f4a65d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:14.050325 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-9f70299d-979b-4c1d-90b3-369627f4a65d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:57:14.052979 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 437/853] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:14.064723 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d07a93-0e45-42a1-aa11-37be1da99cc1 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.076225 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d07a93-0e45-42a1-aa11-37be1da99cc1 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.081713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97ba15-880f-49ab-a57e-babd17ddaf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.082422 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97ba15-880f-49ab-a57e-babd17ddaf95 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.082681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97ba15-880f-49ab-a57e-babd17ddaf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.082963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97ba15-880f-49ab-a57e-babd17ddaf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.083724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97ba15-880f-49ab-a57e-babd17ddaf95 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:14.084031 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97ba15-880f-49ab-a57e-babd17ddaf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.085627 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97ba15-880f-49ab-a57e-babd17ddaf95 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.096038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 417/854] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:14.106799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70299d-979b-4c1d-90b3-369627f4a65d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.119345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70299d-979b-4c1d-90b3-369627f4a65d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.123884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d74e9-5633-43cb-9e40-54deb85b8b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.124664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d74e9-5633-43cb-9e40-54deb85b8b63 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.124948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d74e9-5633-43cb-9e40-54deb85b8b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.125228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d74e9-5633-43cb-9e40-54deb85b8b63 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.140817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d74e9-5633-43cb-9e40-54deb85b8b63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.143753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d74e9-5633-43cb-9e40-54deb85b8b63 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.164918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-9e4d74e9-5633-43cb-9e40-54deb85b8b63 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:14.166883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 438/855] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:14.173581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97ba15-880f-49ab-a57e-babd17ddaf95 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.183561 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97ba15-880f-49ab-a57e-babd17ddaf95 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.188371 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d72ff-c7ba-4237-a1d0-97a45e343659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.189271 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d72ff-c7ba-4237-a1d0-97a45e343659 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.189791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d72ff-c7ba-4237-a1d0-97a45e343659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.190501 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d72ff-c7ba-4237-a1d0-97a45e343659 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.193178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d72ff-c7ba-4237-a1d0-97a45e343659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:14.194201 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d72ff-c7ba-4237-a1d0-97a45e343659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.196249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d72ff-c7ba-4237-a1d0-97a45e343659 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.210224 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 418/856] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:14.216224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d74e9-5633-43cb-9e40-54deb85b8b63 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.231849 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d74e9-5633-43cb-9e40-54deb85b8b63 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.237371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997bcd8-88ad-4460-acad-eba2b0615395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.238182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997bcd8-88ad-4460-acad-eba2b0615395 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.238564 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997bcd8-88ad-4460-acad-eba2b0615395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.238839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997bcd8-88ad-4460-acad-eba2b0615395 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.246880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997bcd8-88ad-4460-acad-eba2b0615395 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.248956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997bcd8-88ad-4460-acad-eba2b0615395 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.264404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-c997bcd8-88ad-4460-acad-eba2b0615395 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 09 00:57:14.266423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 439/857] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:14.272686 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d72ff-c7ba-4237-a1d0-97a45e343659 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.283240 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d72ff-c7ba-4237-a1d0-97a45e343659 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.287919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac36198-114d-434a-b0d3-a95d6a01ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.288589 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac36198-114d-434a-b0d3-a95d6a01ceb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.288866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac36198-114d-434a-b0d3-a95d6a01ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.289138 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac36198-114d-434a-b0d3-a95d6a01ceb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.289978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac36198-114d-434a-b0d3-a95d6a01ceb0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:14.290281 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac36198-114d-434a-b0d3-a95d6a01ceb0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.292134 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac36198-114d-434a-b0d3-a95d6a01ceb0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.314831 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 419/858] 10.222.0.23 () {56 vars in 1156 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:14.321201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997bcd8-88ad-4460-acad-eba2b0615395 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.331633 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997bcd8-88ad-4460-acad-eba2b0615395 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.337723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea1f10-5bd9-4ee6-b1d7-9151caa5d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.338446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea1f10-5bd9-4ee6-b1d7-9151caa5d78e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.338728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea1f10-5bd9-4ee6-b1d7-9151caa5d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.339002 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea1f10-5bd9-4ee6-b1d7-9151caa5d78e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.348202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea1f10-5bd9-4ee6-b1d7-9151caa5d78e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.350280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea1f10-5bd9-4ee6-b1d7-9151caa5d78e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.370637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 440/859] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:57:14.376988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac36198-114d-434a-b0d3-a95d6a01ceb0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.387616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac36198-114d-434a-b0d3-a95d6a01ceb0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.392573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8e8de-b5c8-4748-92c6-0640d025c3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.393419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8e8de-b5c8-4748-92c6-0640d025c3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.393705 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8e8de-b5c8-4748-92c6-0640d025c3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.393975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8e8de-b5c8-4748-92c6-0640d025c3d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.406084 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8e8de-b5c8-4748-92c6-0640d025c3d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.408590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8e8de-b5c8-4748-92c6-0640d025c3d8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.426929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-88f8e8de-b5c8-4748-92c6-0640d025c3d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:14.428481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 420/860] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:14.434802 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea1f10-5bd9-4ee6-b1d7-9151caa5d78e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.443993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea1f10-5bd9-4ee6-b1d7-9151caa5d78e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.448636 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af65857-141f-4fd1-a3cf-e271b861f9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.449279 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af65857-141f-4fd1-a3cf-e271b861f9ce admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.449556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af65857-141f-4fd1-a3cf-e271b861f9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.449830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af65857-141f-4fd1-a3cf-e271b861f9ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.450575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af65857-141f-4fd1-a3cf-e271b861f9ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:14.450879 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af65857-141f-4fd1-a3cf-e271b861f9ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.452448 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af65857-141f-4fd1-a3cf-e271b861f9ce admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.465495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 441/861] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:14.472422 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8e8de-b5c8-4748-92c6-0640d025c3d8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.482522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8e8de-b5c8-4748-92c6-0640d025c3d8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.487638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77be88-79ca-49c0-8474-171ea9e8465a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.488533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77be88-79ca-49c0-8474-171ea9e8465a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.488811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77be88-79ca-49c0-8474-171ea9e8465a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.489082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77be88-79ca-49c0-8474-171ea9e8465a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.496622 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77be88-79ca-49c0-8474-171ea9e8465a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.498642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77be88-79ca-49c0-8474-171ea9e8465a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.512536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-0b77be88-79ca-49c0-8474-171ea9e8465a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:14.514003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 421/862] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:14.520289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af65857-141f-4fd1-a3cf-e271b861f9ce admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.532429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af65857-141f-4fd1-a3cf-e271b861f9ce admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.537233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561d9ce-2112-4d79-b1af-9baa80cc3d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.538184 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561d9ce-2112-4d79-b1af-9baa80cc3d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.538490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561d9ce-2112-4d79-b1af-9baa80cc3d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.538765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561d9ce-2112-4d79-b1af-9baa80cc3d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.539609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561d9ce-2112-4d79-b1af-9baa80cc3d4a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:14.540112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561d9ce-2112-4d79-b1af-9baa80cc3d4a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.542070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561d9ce-2112-4d79-b1af-9baa80cc3d4a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.555666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 442/863] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:14.561929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77be88-79ca-49c0-8474-171ea9e8465a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.572928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77be88-79ca-49c0-8474-171ea9e8465a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.577371 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523467f5-cc81-42df-a36e-602b1c48f7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.578010 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523467f5-cc81-42df-a36e-602b1c48f7ea admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.578287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523467f5-cc81-42df-a36e-602b1c48f7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.579289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523467f5-cc81-42df-a36e-602b1c48f7ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.580139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523467f5-cc81-42df-a36e-602b1c48f7ea admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=f2a17190105a4228bdd94926e1a2091e) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:14.580446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523467f5-cc81-42df-a36e-602b1c48f7ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.582285 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523467f5-cc81-42df-a36e-602b1c48f7ea admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.589059 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 422/864] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/role_assignments?user.id=f2a17190105a4228bdd94926e1a2091e&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:14.726770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed3017-a269-40b2-a0a9-0d5d6078b559 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.727095 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed3017-a269-40b2-a0a9-0d5d6078b559 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.727261 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed3017-a269-40b2-a0a9-0d5d6078b559 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.729246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 443/865] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:14.737054 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401bddb-1e23-4c33-bfde-09550e977d66 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.737481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401bddb-1e23-4c33-bfde-09550e977d66 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.737854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401bddb-1e23-4c33-bfde-09550e977d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.757885 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-a401bddb-1e23-4c33-bfde-09550e977d66 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:14.759292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a401bddb-1e23-4c33-bfde-09550e977d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:14.767695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 423/866] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:14 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:14.791473 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed3017-a269-40b2-a0a9-0d5d6078b559 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.804851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed3017-a269-40b2-a0a9-0d5d6078b559 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.809329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20d7c2-8d54-4d40-86fa-f20646cb81a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.810224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20d7c2-8d54-4d40-86fa-f20646cb81a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.810624 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20d7c2-8d54-4d40-86fa-f20646cb81a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.811012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20d7c2-8d54-4d40-86fa-f20646cb81a1 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.811773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20d7c2-8d54-4d40-86fa-f20646cb81a1 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.813533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20d7c2-8d54-4d40-86fa-f20646cb81a1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.823551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c28b21-8fa4-4a00-bfd9-92080530e68e None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.823551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c28b21-8fa4-4a00-bfd9-92080530e68e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.823551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c28b21-8fa4-4a00-bfd9-92080530e68e None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.823551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 424/867] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:57:14.825712 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-5f20d7c2-8d54-4d40-86fa-f20646cb81a1 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 09 00:57:14.827365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 444/868] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:14.831925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e835d4-6d1e-4f81-b941-7da32a669b76 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.831925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e835d4-6d1e-4f81-b941-7da32a669b76 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.831925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e835d4-6d1e-4f81-b941-7da32a669b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.834306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20d7c2-8d54-4d40-86fa-f20646cb81a1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.845804 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20d7c2-8d54-4d40-86fa-f20646cb81a1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.852059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1450695-ebe5-43b6-b579-6c4ec9d0d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.852955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1450695-ebe5-43b6-b579-6c4ec9d0d6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.853420 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1450695-ebe5-43b6-b579-6c4ec9d0d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.853700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1450695-ebe5-43b6-b579-6c4ec9d0d6a5 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.854944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1450695-ebe5-43b6-b579-6c4ec9d0d6a5 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:14.854944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1450695-ebe5-43b6-b579-6c4ec9d0d6a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.855274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b8e835d4-6d1e-4f81-b941-7da32a669b76 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:14.856515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b8e835d4-6d1e-4f81-b941-7da32a669b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:14.856777 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1450695-ebe5-43b6-b579-6c4ec9d0d6a5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.863465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 445/869] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:14.869922 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1450695-ebe5-43b6-b579-6c4ec9d0d6a5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.874425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 425/870] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:14 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:14.881818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1450695-ebe5-43b6-b579-6c4ec9d0d6a5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.889055 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852a8f5-e428-4bad-baa7-c9e4d4ee3085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.890241 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852a8f5-e428-4bad-baa7-c9e4d4ee3085 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.890817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852a8f5-e428-4bad-baa7-c9e4d4ee3085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.891915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852a8f5-e428-4bad-baa7-c9e4d4ee3085 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.893169 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852a8f5-e428-4bad-baa7-c9e4d4ee3085 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:14.893709 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852a8f5-e428-4bad-baa7-c9e4d4ee3085 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.895723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852a8f5-e428-4bad-baa7-c9e4d4ee3085 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.899360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e835d4-6d1e-4f81-b941-7da32a669b76 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.904697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 446/871] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:14.909043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e835d4-6d1e-4f81-b941-7da32a669b76 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.913908 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f4d57-5928-4460-a261-591f10229360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.914936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f4d57-5928-4460-a261-591f10229360 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.915313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f4d57-5928-4460-a261-591f10229360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.915682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f4d57-5928-4460-a261-591f10229360 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.928771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f4d57-5928-4460-a261-591f10229360 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:14.936514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-bc1f4d57-5928-4460-a261-591f10229360 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 09 00:57:14.942541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 426/872] 10.222.0.23 () {56 vars in 1141 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:14.945955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852a8f5-e428-4bad-baa7-c9e4d4ee3085 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.956826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852a8f5-e428-4bad-baa7-c9e4d4ee3085 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:14.961690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612c71d-ac2e-451c-8abd-30760359e6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:14.962566 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612c71d-ac2e-451c-8abd-30760359e6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:14.962976 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612c71d-ac2e-451c-8abd-30760359e6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:14.963341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612c71d-ac2e-451c-8abd-30760359e6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:14.964158 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612c71d-ac2e-451c-8abd-30760359e6f0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:14.964460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612c71d-ac2e-451c-8abd-30760359e6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:14.966119 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612c71d-ac2e-451c-8abd-30760359e6f0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:14.982352 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 447/873] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:14.983773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f4d57-5928-4460-a261-591f10229360 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:14.995248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f4d57-5928-4460-a261-591f10229360 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:15.000098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bc3cc-8e02-4e3e-8ace-c209758dc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:15.001570 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bc3cc-8e02-4e3e-8ace-c209758dc1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.001846 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bc3cc-8e02-4e3e-8ace-c209758dc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.002115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bc3cc-8e02-4e3e-8ace-c209758dc1f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.014623 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bc3cc-8e02-4e3e-8ace-c209758dc1f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:15.016567 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bc3cc-8e02-4e3e-8ace-c209758dc1f8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:15.034454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-662bc3cc-8e02-4e3e-8ace-c209758dc1f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:15.039494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 427/874] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:15.042311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612c71d-ac2e-451c-8abd-30760359e6f0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:15.053445 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612c71d-ac2e-451c-8abd-30760359e6f0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:15.058467 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cb098-3842-4c19-82e5-a36dc71ade54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:15.059172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cb098-3842-4c19-82e5-a36dc71ade54 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.059505 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cb098-3842-4c19-82e5-a36dc71ade54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.059775 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cb098-3842-4c19-82e5-a36dc71ade54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.060509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cb098-3842-4c19-82e5-a36dc71ade54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:15.060863 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cb098-3842-4c19-82e5-a36dc71ade54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:15.062630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cb098-3842-4c19-82e5-a36dc71ade54 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:15.082169 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 448/875] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:15.083683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bc3cc-8e02-4e3e-8ace-c209758dc1f8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:15.094881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bc3cc-8e02-4e3e-8ace-c209758dc1f8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:15.099716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e1fd4-e626-4e2e-8133-f20056db8e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:15.100587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e1fd4-e626-4e2e-8133-f20056db8e6a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.100870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e1fd4-e626-4e2e-8133-f20056db8e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.101143 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e1fd4-e626-4e2e-8133-f20056db8e6a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.110603 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e1fd4-e626-4e2e-8133-f20056db8e6a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:15.113391 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e1fd4-e626-4e2e-8133-f20056db8e6a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:15.128873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-5d9e1fd4-e626-4e2e-8133-f20056db8e6a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 09 00:57:15.130130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 428/876] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Dec 9 00:57:15 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:15.136472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cb098-3842-4c19-82e5-a36dc71ade54 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:15.148487 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cb098-3842-4c19-82e5-a36dc71ade54 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:15.155081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e509390-61be-4d54-b3fa-eea51ef8ded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:15.155209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e509390-61be-4d54-b3fa-eea51ef8ded3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.155837 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e509390-61be-4d54-b3fa-eea51ef8ded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.155837 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e509390-61be-4d54-b3fa-eea51ef8ded3 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.157097 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e509390-61be-4d54-b3fa-eea51ef8ded3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:15.157668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e509390-61be-4d54-b3fa-eea51ef8ded3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:15.159401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e509390-61be-4d54-b3fa-eea51ef8ded3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:15.180687 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 449/877] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Dec 9 00:57:15 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:15.184549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e1fd4-e626-4e2e-8133-f20056db8e6a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:15.195235 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e1fd4-e626-4e2e-8133-f20056db8e6a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:15.199937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81daee67-8c92-4dcc-9234-ccde6697d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:15.200585 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81daee67-8c92-4dcc-9234-ccde6697d1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.200864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81daee67-8c92-4dcc-9234-ccde6697d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.201135 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81daee67-8c92-4dcc-9234-ccde6697d1c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.209717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81daee67-8c92-4dcc-9234-ccde6697d1c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:15.211494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81daee67-8c92-4dcc-9234-ccde6697d1c4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:15.226485 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 429/878] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:15 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:57:15.227840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e509390-61be-4d54-b3fa-eea51ef8ded3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:15.240432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e509390-61be-4d54-b3fa-eea51ef8ded3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:15.245150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc9dc2-d841-4cec-b438-70f6928903e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:15.246165 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc9dc2-d841-4cec-b438-70f6928903e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.246642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc9dc2-d841-4cec-b438-70f6928903e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.247054 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc9dc2-d841-4cec-b438-70f6928903e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.257831 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc9dc2-d841-4cec-b438-70f6928903e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:15.259885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc9dc2-d841-4cec-b438-70f6928903e6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:15.262918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0005244-6c49-4877-aeae-09e8514a6a89 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.263378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0005244-6c49-4877-aeae-09e8514a6a89 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.263795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0005244-6c49-4877-aeae-09e8514a6a89 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.265994 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 430/879] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:57:15.272266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dac976-a159-48c8-aa25-77b88ddc969e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.272767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dac976-a159-48c8-aa25-77b88ddc969e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.273212 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dac976-a159-48c8-aa25-77b88ddc969e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.278261 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-1ebc9dc2-d841-4cec-b438-70f6928903e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:15.285079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 450/880] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:15.286759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc9dc2-d841-4cec-b438-70f6928903e6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:15.294912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-f5dac976-a159-48c8-aa25-77b88ddc969e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:15.296085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f5dac976-a159-48c8-aa25-77b88ddc969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:15.297013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc9dc2-d841-4cec-b438-70f6928903e6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:15.302696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f5005-4810-49c8-945c-a582184310fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:15.303590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f5005-4810-49c8-945c-a582184310fd admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.304055 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f5005-4810-49c8-945c-a582184310fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.304557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f5005-4810-49c8-945c-a582184310fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.304931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 431/881] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:15 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:15.305756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f5005-4810-49c8-945c-a582184310fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:15.306291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f5005-4810-49c8-945c-a582184310fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:15.308229 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f5005-4810-49c8-945c-a582184310fd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:15.325045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 451/882] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:15.326608 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dac976-a159-48c8-aa25-77b88ddc969e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:15.328604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f5005-4810-49c8-945c-a582184310fd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:15.337035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dac976-a159-48c8-aa25-77b88ddc969e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:15.339234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f5005-4810-49c8-945c-a582184310fd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:15.342296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e891dd5-68d3-4438-838e-c81286dd1c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:15.343475 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891dd5-68d3-4438-838e-c81286dd1c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.343946 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891dd5-68d3-4438-838e-c81286dd1c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.344725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f21bb9-a96b-4759-8cd7-83477f3e3340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:15.345079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891dd5-68d3-4438-838e-c81286dd1c9d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.345497 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f21bb9-a96b-4759-8cd7-83477f3e3340 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.345847 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f21bb9-a96b-4759-8cd7-83477f3e3340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.346184 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f21bb9-a96b-4759-8cd7-83477f3e3340 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.347021 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f21bb9-a96b-4759-8cd7-83477f3e3340 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:15.349194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f21bb9-a96b-4759-8cd7-83477f3e3340 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:15.353509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e891dd5-68d3-4438-838e-c81286dd1c9d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:15.355751 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e891dd5-68d3-4438-838e-c81286dd1c9d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:15.365320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 452/883] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:57:15 2021] POST /identity/v3/services => generated 269 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 00:57:15.370884 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-5e891dd5-68d3-4438-838e-c81286dd1c9d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:15.378306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 432/884] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:15.379883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f21bb9-a96b-4759-8cd7-83477f3e3340 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:15.401794 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f21bb9-a96b-4759-8cd7-83477f3e3340 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:15.407814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e2ea1-e96d-4898-a1d9-ae1de37533bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:15.408544 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e2ea1-e96d-4898-a1d9-ae1de37533bb admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.408828 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e2ea1-e96d-4898-a1d9-ae1de37533bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.409101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e2ea1-e96d-4898-a1d9-ae1de37533bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.409961 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e2ea1-e96d-4898-a1d9-ae1de37533bb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:15.410467 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e2ea1-e96d-4898-a1d9-ae1de37533bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:15.412600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e2ea1-e96d-4898-a1d9-ae1de37533bb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:15.427608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 453/885] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:15.434705 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e891dd5-68d3-4438-838e-c81286dd1c9d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:15.447692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e891dd5-68d3-4438-838e-c81286dd1c9d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:15.452537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9001fae-3609-4c87-acce-508fb41bd4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:15.453292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9001fae-3609-4c87-acce-508fb41bd4ba admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:15.453612 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9001fae-3609-4c87-acce-508fb41bd4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:15.454048 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9001fae-3609-4c87-acce-508fb41bd4ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:15.454972 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9001fae-3609-4c87-acce-508fb41bd4ba admin admin] RBAC: Adding query filter params (role.id=a0c4d698c22c4b8e8a5d633ba758a5bb, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=7ccda27976ad40f2a62a50189f0fdc63) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:15.455327 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9001fae-3609-4c87-acce-508fb41bd4ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:15.457232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9001fae-3609-4c87-acce-508fb41bd4ba admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:15.470611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 433/886] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:15 2021] GET /identity/v3/role_assignments?user.id=7ccda27976ad40f2a62a50189f0fdc63&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=a0c4d698c22c4b8e8a5d633ba758a5bb => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:17.108101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926063ab-f047-4556-819a-305449124e67 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.108595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926063ab-f047-4556-819a-305449124e67 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.108595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926063ab-f047-4556-819a-305449124e67 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.111214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 454/887] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:17.117741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85659a2-6c88-4192-93ee-80a922a4c6fc None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.118172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85659a2-6c88-4192-93ee-80a922a4c6fc None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.118304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85659a2-6c88-4192-93ee-80a922a4c6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.135860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d85659a2-6c88-4192-93ee-80a922a4c6fc None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:17.137043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d85659a2-6c88-4192-93ee-80a922a4c6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:17.145854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 434/888] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:17 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:17.168934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926063ab-f047-4556-819a-305449124e67 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:17.181329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926063ab-f047-4556-819a-305449124e67 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:17.185713 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769623c9-ba82-4be6-b1fe-4c825279c979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:17.186572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769623c9-ba82-4be6-b1fe-4c825279c979 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.186853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769623c9-ba82-4be6-b1fe-4c825279c979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.187122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769623c9-ba82-4be6-b1fe-4c825279c979 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.187938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769623c9-ba82-4be6-b1fe-4c825279c979 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:17.189524 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769623c9-ba82-4be6-b1fe-4c825279c979 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:17.200824 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-769623c9-ba82-4be6-b1fe-4c825279c979 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 09 00:57:17.202274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 455/889] 10.222.0.23 () {56 vars in 1147 bytes} [Thu Dec 9 00:57:17 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:17.209286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85659a2-6c88-4192-93ee-80a922a4c6fc None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:17.218375 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85659a2-6c88-4192-93ee-80a922a4c6fc None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:17.223067 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7443a23-0cc2-421a-be50-14cfb79d7115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:17.223728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7443a23-0cc2-421a-be50-14cfb79d7115 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.224010 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7443a23-0cc2-421a-be50-14cfb79d7115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.224284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7443a23-0cc2-421a-be50-14cfb79d7115 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.225003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7443a23-0cc2-421a-be50-14cfb79d7115 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:17.225310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7443a23-0cc2-421a-be50-14cfb79d7115 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:17.226927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7443a23-0cc2-421a-be50-14cfb79d7115 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:17.232002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 435/890] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Dec 9 00:57:17 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:17.239171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769623c9-ba82-4be6-b1fe-4c825279c979 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:17.248950 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769623c9-ba82-4be6-b1fe-4c825279c979 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:17.253581 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a3c49-c832-46a2-a522-653dcd40a1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:17.254230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3c49-c832-46a2-a522-653dcd40a1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.254541 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3c49-c832-46a2-a522-653dcd40a1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.254817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3c49-c832-46a2-a522-653dcd40a1a4 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.255535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a3c49-c832-46a2-a522-653dcd40a1a4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:17.255843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a3c49-c832-46a2-a522-653dcd40a1a4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:17.257429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a3c49-c832-46a2-a522-653dcd40a1a4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:17.262001 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 456/891] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Dec 9 00:57:17 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:17.459600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b843f9-47f9-4f4d-86be-c1b32e30dd7f None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.459787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b843f9-47f9-4f4d-86be-c1b32e30dd7f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.460065 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b843f9-47f9-4f4d-86be-c1b32e30dd7f None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.462307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 436/892] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:17.468339 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01eea4-9cb3-4c92-8f88-a1bb5f3e167b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.468627 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01eea4-9cb3-4c92-8f88-a1bb5f3e167b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.469490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01eea4-9cb3-4c92-8f88-a1bb5f3e167b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.490874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9f01eea4-9cb3-4c92-8f88-a1bb5f3e167b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:17.492250 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9f01eea4-9cb3-4c92-8f88-a1bb5f3e167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:17.501081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 457/893] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:17 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:17.527305 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b843f9-47f9-4f4d-86be-c1b32e30dd7f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:17.540803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b843f9-47f9-4f4d-86be-c1b32e30dd7f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:17.545568 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45575cb-54e7-4ab1-881a-419c28cffeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:17.546461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45575cb-54e7-4ab1-881a-419c28cffeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.546942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45575cb-54e7-4ab1-881a-419c28cffeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.547471 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45575cb-54e7-4ab1-881a-419c28cffeb3 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.548508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45575cb-54e7-4ab1-881a-419c28cffeb3 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:17.550303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45575cb-54e7-4ab1-881a-419c28cffeb3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:17.567071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 437/894] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:57:17 2021] POST /identity/v3/services => generated 251 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:17.835137 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab276fec-db09-490c-8a6b-73ebe1505366 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.835514 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab276fec-db09-490c-8a6b-73ebe1505366 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.835684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab276fec-db09-490c-8a6b-73ebe1505366 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.837713 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 458/895] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:17.843665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf154b86-ef33-48d2-9c8c-9b0cf0ce74c9 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.844584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf154b86-ef33-48d2-9c8c-9b0cf0ce74c9 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.844880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf154b86-ef33-48d2-9c8c-9b0cf0ce74c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.865005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-cf154b86-ef33-48d2-9c8c-9b0cf0ce74c9 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:17.866533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-cf154b86-ef33-48d2-9c8c-9b0cf0ce74c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:17.883497 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 438/896] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:17 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:17.889913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c8e0-e809-4288-987e-5be7dee48040 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.890201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c8e0-e809-4288-987e-5be7dee48040 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.890504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c8e0-e809-4288-987e-5be7dee48040 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.892956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 459/897] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:17.898788 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64723f3b-7e4f-4d1b-acc8-a92a47059e0d None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.899274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64723f3b-7e4f-4d1b-acc8-a92a47059e0d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.899751 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64723f3b-7e4f-4d1b-acc8-a92a47059e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.912207 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c8e0-e809-4288-987e-5be7dee48040 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:17.918696 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-64723f3b-7e4f-4d1b-acc8-a92a47059e0d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:17.920042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-64723f3b-7e4f-4d1b-acc8-a92a47059e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:17.924997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c8e0-e809-4288-987e-5be7dee48040 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:17.929096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 439/898] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:17 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:17.929814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a1952-6b31-430b-9d42-c35264c566da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:17.930890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a1952-6b31-430b-9d42-c35264c566da admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.931373 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a1952-6b31-430b-9d42-c35264c566da admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.931849 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a1952-6b31-430b-9d42-c35264c566da admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.932708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a1952-6b31-430b-9d42-c35264c566da admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:17.934551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a1952-6b31-430b-9d42-c35264c566da admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:17.946418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-073a1952-6b31-430b-9d42-c35264c566da admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 09 00:57:17.948113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 460/899] 10.222.0.23 () {56 vars in 1153 bytes} [Thu Dec 9 00:57:17 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:17.952868 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64723f3b-7e4f-4d1b-acc8-a92a47059e0d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:17.955700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a1952-6b31-430b-9d42-c35264c566da admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:17.963630 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64723f3b-7e4f-4d1b-acc8-a92a47059e0d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:17.965613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a1952-6b31-430b-9d42-c35264c566da admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:17.968139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036ef4b-1e77-4bd9-b15a-ad9d8ee02117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:17.968988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036ef4b-1e77-4bd9-b15a-ad9d8ee02117 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.969911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036ef4b-1e77-4bd9-b15a-ad9d8ee02117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.970198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036ef4b-1e77-4bd9-b15a-ad9d8ee02117 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.971354 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8664bb-dbe0-4f2c-8491-d8df93815052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:17.972219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8664bb-dbe0-4f2c-8491-d8df93815052 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:17.972698 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8664bb-dbe0-4f2c-8491-d8df93815052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:17.973153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8664bb-dbe0-4f2c-8491-d8df93815052 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:17.974058 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8664bb-dbe0-4f2c-8491-d8df93815052 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:17.974567 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8664bb-dbe0-4f2c-8491-d8df93815052 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:17.976330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8664bb-dbe0-4f2c-8491-d8df93815052 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:17.981935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 461/900] 10.222.0.23 () {56 vars in 1147 bytes} [Thu Dec 9 00:57:17 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:17.986588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036ef4b-1e77-4bd9-b15a-ad9d8ee02117 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:17.989163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8664bb-dbe0-4f2c-8491-d8df93815052 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:17.991336 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-9036ef4b-1e77-4bd9-b15a-ad9d8ee02117 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 09 00:57:17.992842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 440/901] 10.222.0.23 () {56 vars in 1141 bytes} [Thu Dec 9 00:57:17 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:17.999014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036ef4b-1e77-4bd9-b15a-ad9d8ee02117 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:17.999792 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8664bb-dbe0-4f2c-8491-d8df93815052 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.005015 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b8e8e-7bf8-4c0c-8657-3ab86cc55fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.006512 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b8e8e-7bf8-4c0c-8657-3ab86cc55fde admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.006982 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b8e8e-7bf8-4c0c-8657-3ab86cc55fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.007433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b8e8e-7bf8-4c0c-8657-3ab86cc55fde admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.008584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b8e8e-7bf8-4c0c-8657-3ab86cc55fde admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:18.009174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b8e8e-7bf8-4c0c-8657-3ab86cc55fde admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.010068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036ef4b-1e77-4bd9-b15a-ad9d8ee02117 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.011198 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b8e8e-7bf8-4c0c-8657-3ab86cc55fde admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.014922 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0b75f-77f2-4f05-bc7d-66b367a992eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.015648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0b75f-77f2-4f05-bc7d-66b367a992eb admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.016727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0b75f-77f2-4f05-bc7d-66b367a992eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.017537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0b75f-77f2-4f05-bc7d-66b367a992eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.018490 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0b75f-77f2-4f05-bc7d-66b367a992eb admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:18.018679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 462/902] 10.222.0.23 () {56 vars in 1147 bytes} [Thu Dec 9 00:57:17 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:18.018777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0b75f-77f2-4f05-bc7d-66b367a992eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.022572 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0b75f-77f2-4f05-bc7d-66b367a992eb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.024948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b8e8e-7bf8-4c0c-8657-3ab86cc55fde admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:18.032557 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 441/903] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Dec 9 00:57:17 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:18.038271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b8e8e-7bf8-4c0c-8657-3ab86cc55fde admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.039249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0b75f-77f2-4f05-bc7d-66b367a992eb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:18.042051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6c7c7-a6bc-4eda-9d58-16e3326ff9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.046105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6c7c7-a6bc-4eda-9d58-16e3326ff9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.046637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6c7c7-a6bc-4eda-9d58-16e3326ff9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.047692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6c7c7-a6bc-4eda-9d58-16e3326ff9f1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.048878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6c7c7-a6bc-4eda-9d58-16e3326ff9f1 admin admin] RBAC: Adding query filter params (interface=public, service_id=0113f6152ada4798bcceb9056891cecc, region_id=RegionOne) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:18.049413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6c7c7-a6bc-4eda-9d58-16e3326ff9f1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.051236 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6c7c7-a6bc-4eda-9d58-16e3326ff9f1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.052492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0b75f-77f2-4f05-bc7d-66b367a992eb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.057226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c290c1-54eb-4e8b-9b8f-07db819a971d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.058124 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c290c1-54eb-4e8b-9b8f-07db819a971d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.058292 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 463/904] 10.222.0.23 () {56 vars in 1272 bytes} [Thu Dec 9 00:57:18 2021] GET /identity/v3/endpoints?service_id=0113f6152ada4798bcceb9056891cecc&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:18.062456 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c290c1-54eb-4e8b-9b8f-07db819a971d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.063660 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c290c1-54eb-4e8b-9b8f-07db819a971d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.065519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6c7c7-a6bc-4eda-9d58-16e3326ff9f1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:18.075791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c290c1-54eb-4e8b-9b8f-07db819a971d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.076906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6c7c7-a6bc-4eda-9d58-16e3326ff9f1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.077843 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c290c1-54eb-4e8b-9b8f-07db819a971d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.082926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81f5ed-ca54-486c-964e-82612030e60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.083804 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81f5ed-ca54-486c-964e-82612030e60a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.084302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81f5ed-ca54-486c-964e-82612030e60a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.084774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81f5ed-ca54-486c-964e-82612030e60a admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.085708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81f5ed-ca54-486c-964e-82612030e60a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.088319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81f5ed-ca54-486c-964e-82612030e60a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.102394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-c6c290c1-54eb-4e8b-9b8f-07db819a971d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:18.102594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 442/906] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:18.102913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 464/906] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Dec 9 00:57:18 2021] GET /identity/v3/services => generated 1268 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 00:57:18.104963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c290c1-54eb-4e8b-9b8f-07db819a971d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:18.117186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c290c1-54eb-4e8b-9b8f-07db819a971d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.122186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3bafc-b4c6-4329-b0c6-6f9df52bd203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.122969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3bafc-b4c6-4329-b0c6-6f9df52bd203 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.123233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3bafc-b4c6-4329-b0c6-6f9df52bd203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.123508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3bafc-b4c6-4329-b0c6-6f9df52bd203 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.124310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3bafc-b4c6-4329-b0c6-6f9df52bd203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:18.124617 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3bafc-b4c6-4329-b0c6-6f9df52bd203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.127265 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3bafc-b4c6-4329-b0c6-6f9df52bd203 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.145062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 443/907] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:18.151214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81f5ed-ca54-486c-964e-82612030e60a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:18.162205 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81f5ed-ca54-486c-964e-82612030e60a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.169019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa75e26-12e1-4818-9f98-2298a2d62653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.169846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa75e26-12e1-4818-9f98-2298a2d62653 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.170131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa75e26-12e1-4818-9f98-2298a2d62653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.170436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa75e26-12e1-4818-9f98-2298a2d62653 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.180983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa75e26-12e1-4818-9f98-2298a2d62653 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.183064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa75e26-12e1-4818-9f98-2298a2d62653 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.199630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-7fa75e26-12e1-4818-9f98-2298a2d62653 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 09 00:57:18.201265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 465/908] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Dec 9 00:57:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:18.208646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3bafc-b4c6-4329-b0c6-6f9df52bd203 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:18.219431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3bafc-b4c6-4329-b0c6-6f9df52bd203 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.225151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172dfe2-f3f0-489f-b25d-4954a994e391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.225921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172dfe2-f3f0-489f-b25d-4954a994e391 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.226207 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172dfe2-f3f0-489f-b25d-4954a994e391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.226558 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172dfe2-f3f0-489f-b25d-4954a994e391 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.227421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172dfe2-f3f0-489f-b25d-4954a994e391 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:18.227776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172dfe2-f3f0-489f-b25d-4954a994e391 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.229701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172dfe2-f3f0-489f-b25d-4954a994e391 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.251960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 444/909] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Dec 9 00:57:18 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:18.257850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa75e26-12e1-4818-9f98-2298a2d62653 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:18.268934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa75e26-12e1-4818-9f98-2298a2d62653 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.273732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffada7-9638-4761-a5bc-aa351cd47cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.274614 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffada7-9638-4761-a5bc-aa351cd47cdf admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.274897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffada7-9638-4761-a5bc-aa351cd47cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.275213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffada7-9638-4761-a5bc-aa351cd47cdf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.288894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffada7-9638-4761-a5bc-aa351cd47cdf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.290845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffada7-9638-4761-a5bc-aa351cd47cdf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.309990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-57ffada7-9638-4761-a5bc-aa351cd47cdf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:18.311585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 466/910] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:18.318580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172dfe2-f3f0-489f-b25d-4954a994e391 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:18.329522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172dfe2-f3f0-489f-b25d-4954a994e391 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.334221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a95de-e96b-4776-8522-6cdd5e231745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.334928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a95de-e96b-4776-8522-6cdd5e231745 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.335202 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a95de-e96b-4776-8522-6cdd5e231745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.335479 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a95de-e96b-4776-8522-6cdd5e231745 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.336268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a95de-e96b-4776-8522-6cdd5e231745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:18.336521 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a95de-e96b-4776-8522-6cdd5e231745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.338109 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a95de-e96b-4776-8522-6cdd5e231745 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.352262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 445/911] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:18.358145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffada7-9638-4761-a5bc-aa351cd47cdf admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:18.369199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffada7-9638-4761-a5bc-aa351cd47cdf admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.373846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714449-b13e-4ba7-8d7e-70dfe506b904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.374661 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714449-b13e-4ba7-8d7e-70dfe506b904 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.374944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714449-b13e-4ba7-8d7e-70dfe506b904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.375784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714449-b13e-4ba7-8d7e-70dfe506b904 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.383254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4714449-b13e-4ba7-8d7e-70dfe506b904 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.385160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4714449-b13e-4ba7-8d7e-70dfe506b904 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.402323 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-b4714449-b13e-4ba7-8d7e-70dfe506b904 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:18.403886 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 467/912] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:18.411270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a95de-e96b-4776-8522-6cdd5e231745 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:18.421585 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a95de-e96b-4776-8522-6cdd5e231745 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.430457 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9e15a-03bf-4df2-809a-41504cdad51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.431336 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9e15a-03bf-4df2-809a-41504cdad51b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.431754 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9e15a-03bf-4df2-809a-41504cdad51b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.432171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9e15a-03bf-4df2-809a-41504cdad51b admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.433116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9e15a-03bf-4df2-809a-41504cdad51b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:18.433569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9e15a-03bf-4df2-809a-41504cdad51b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.435583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9e15a-03bf-4df2-809a-41504cdad51b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.449343 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 446/913] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:18.456515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714449-b13e-4ba7-8d7e-70dfe506b904 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:18.466907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714449-b13e-4ba7-8d7e-70dfe506b904 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:18.472958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aabb75-5973-45d0-a06a-7f79025d42c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:18.474072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aabb75-5973-45d0-a06a-7f79025d42c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:18.474561 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aabb75-5973-45d0-a06a-7f79025d42c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:18.474978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aabb75-5973-45d0-a06a-7f79025d42c7 admin admin] PATH_INFO: `/v3/projects/0566d367619740a48d8dca2def78a386/users/7ccda27976ad40f2a62a50189f0fdc63/roles/a0c4d698c22c4b8e8a5d633ba758a5bb` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:18.477628 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aabb75-5973-45d0-a06a-7f79025d42c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566d367619740a48d8dca2def78a386, user_id=7ccda27976ad40f2a62a50189f0fdc63, role_id=a0c4d698c22c4b8e8a5d633ba758a5bb)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:18.480544 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aabb75-5973-45d0-a06a-7f79025d42c7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:18.502378 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 468/914] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:57:18 2021] PUT /identity/v3/projects/0566d367619740a48d8dca2def78a386/users/7ccda27976ad40f2a62a50189f0fdc63/roles/a0c4d698c22c4b8e8a5d633ba758a5bb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:57:19.741162 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb9f58-4fa2-4054-a8b4-24edbbe39840 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:19.741685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb9f58-4fa2-4054-a8b4-24edbbe39840 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:19.741685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb9f58-4fa2-4054-a8b4-24edbbe39840 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:19.743856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 447/915] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:19.749686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b3c70-5e6e-4545-a7a2-2d6a05ca14e7 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:19.750636 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b3c70-5e6e-4545-a7a2-2d6a05ca14e7 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:19.750822 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b3c70-5e6e-4545-a7a2-2d6a05ca14e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:19.768850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ec0b3c70-5e6e-4545-a7a2-2d6a05ca14e7 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:19.770034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ec0b3c70-5e6e-4545-a7a2-2d6a05ca14e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:19.834722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 469/916] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:19 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:19.851902 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb9f58-4fa2-4054-a8b4-24edbbe39840 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:19.867522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb9f58-4fa2-4054-a8b4-24edbbe39840 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:19.871913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb3d12-6bcc-4312-99cb-916c3ccf42d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:19.872560 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb3d12-6bcc-4312-99cb-916c3ccf42d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:19.872837 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb3d12-6bcc-4312-99cb-916c3ccf42d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:19.873106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb3d12-6bcc-4312-99cb-916c3ccf42d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:19.873845 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb3d12-6bcc-4312-99cb-916c3ccf42d6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:19.875558 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb3d12-6bcc-4312-99cb-916c3ccf42d6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:19.894933 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 448/917] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:57:19 2021] POST /identity/v3/services => generated 241 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:19.994750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4bdc-b73f-48a5-9403-fdcab7263905 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:19.995051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4bdc-b73f-48a5-9403-fdcab7263905 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:19.995249 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4bdc-b73f-48a5-9403-fdcab7263905 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:19.997554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 470/918] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:20.005241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a062abd-20cc-4623-8333-c2ef7015d4b4 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:20.005661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a062abd-20cc-4623-8333-c2ef7015d4b4 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:20.005999 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a062abd-20cc-4623-8333-c2ef7015d4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:20.025183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-1a062abd-20cc-4623-8333-c2ef7015d4b4 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:20.026441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-1a062abd-20cc-4623-8333-c2ef7015d4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:20.046465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 449/919] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:20 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:20.068898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4bdc-b73f-48a5-9403-fdcab7263905 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:20.082534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4bdc-b73f-48a5-9403-fdcab7263905 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:20.087001 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7d52-7231-43d1-ad79-3b2038393465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:20.087805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7d52-7231-43d1-ad79-3b2038393465 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:20.088084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7d52-7231-43d1-ad79-3b2038393465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:20.088350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7d52-7231-43d1-ad79-3b2038393465 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:20.089020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a7d52-7231-43d1-ad79-3b2038393465 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:20.090644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a7d52-7231-43d1-ad79-3b2038393465 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:20.102819 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-f37a7d52-7231-43d1-ad79-3b2038393465 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 09 00:57:20.104380 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 471/920] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:57:20 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:20.111760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a062abd-20cc-4623-8333-c2ef7015d4b4 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:20.121312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a062abd-20cc-4623-8333-c2ef7015d4b4 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:20.127479 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a21b81-9d75-49a3-8254-67948263c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:20.128137 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a21b81-9d75-49a3-8254-67948263c784 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:20.128465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a21b81-9d75-49a3-8254-67948263c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:20.128740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a21b81-9d75-49a3-8254-67948263c784 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:20.129458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a21b81-9d75-49a3-8254-67948263c784 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:20.129762 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a21b81-9d75-49a3-8254-67948263c784 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:20.131383 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a21b81-9d75-49a3-8254-67948263c784 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:20.136804 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 450/921] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:57:20 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:20.142664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7d52-7231-43d1-ad79-3b2038393465 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:20.153238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7d52-7231-43d1-ad79-3b2038393465 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:20.158075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47d8db-44f6-4582-afd8-5b897c4ecd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:20.158788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47d8db-44f6-4582-afd8-5b897c4ecd09 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:20.159064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47d8db-44f6-4582-afd8-5b897c4ecd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:20.159336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47d8db-44f6-4582-afd8-5b897c4ecd09 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:20.160071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47d8db-44f6-4582-afd8-5b897c4ecd09 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:20.160423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47d8db-44f6-4582-afd8-5b897c4ecd09 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:20.162009 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47d8db-44f6-4582-afd8-5b897c4ecd09 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:20.173140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 472/922] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:57:20 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:20.174671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a21b81-9d75-49a3-8254-67948263c784 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:20.185251 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a21b81-9d75-49a3-8254-67948263c784 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:20.190203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44268f4-8422-4e3a-a176-cbdc5b9d0f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:20.190906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44268f4-8422-4e3a-a176-cbdc5b9d0f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:20.191186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44268f4-8422-4e3a-a176-cbdc5b9d0f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:20.191454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44268f4-8422-4e3a-a176-cbdc5b9d0f2f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:20.192270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44268f4-8422-4e3a-a176-cbdc5b9d0f2f admin admin] RBAC: Adding query filter params (interface=public, service_id=c38dacfc3ba747b28d9d504e201c2291, region_id=RegionOne) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:20.192575 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44268f4-8422-4e3a-a176-cbdc5b9d0f2f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:20.194212 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44268f4-8422-4e3a-a176-cbdc5b9d0f2f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:20.206541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 451/923] 10.222.0.23 () {56 vars in 1272 bytes} [Thu Dec 9 00:57:20 2021] GET /identity/v3/endpoints?service_id=c38dacfc3ba747b28d9d504e201c2291&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:20.207951 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47d8db-44f6-4582-afd8-5b897c4ecd09 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:20.220150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47d8db-44f6-4582-afd8-5b897c4ecd09 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:20.225107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0a4b1-299f-4d42-9cc9-2943884e9907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:20.226018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0a4b1-299f-4d42-9cc9-2943884e9907 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:20.226525 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0a4b1-299f-4d42-9cc9-2943884e9907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:20.226972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0a4b1-299f-4d42-9cc9-2943884e9907 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:20.227872 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0a4b1-299f-4d42-9cc9-2943884e9907 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:20.229665 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0a4b1-299f-4d42-9cc9-2943884e9907 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:20.242774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 473/924] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Dec 9 00:57:20 2021] GET /identity/v3/services => generated 1497 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 00:57:20.607166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a7504-2f5e-490d-a64c-7e8543f0fc9c None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:20.607870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a7504-2f5e-490d-a64c-7e8543f0fc9c None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:20.608349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a7504-2f5e-490d-a64c-7e8543f0fc9c None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:20.610841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 452/925] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:20.616620 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f20c66-3725-476c-8407-d93400455790 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:20.616907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f20c66-3725-476c-8407-d93400455790 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:20.617187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f20c66-3725-476c-8407-d93400455790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:20.635848 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-07f20c66-3725-476c-8407-d93400455790 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:20.637041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-07f20c66-3725-476c-8407-d93400455790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:20.645134 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 474/926] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:20 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:20.669138 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a7504-2f5e-490d-a64c-7e8543f0fc9c None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:20.681633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a7504-2f5e-490d-a64c-7e8543f0fc9c None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:20.685980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018e6d5-7072-4083-b6f2-39fee2812105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:20.686806 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018e6d5-7072-4083-b6f2-39fee2812105 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:20.687091 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018e6d5-7072-4083-b6f2-39fee2812105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:20.687366 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018e6d5-7072-4083-b6f2-39fee2812105 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:20.688592 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018e6d5-7072-4083-b6f2-39fee2812105 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:20.690179 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018e6d5-7072-4083-b6f2-39fee2812105 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:20.701664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-0018e6d5-7072-4083-b6f2-39fee2812105 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 09 00:57:20.703181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 453/927] 10.222.0.23 () {56 vars in 1153 bytes} [Thu Dec 9 00:57:20 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:20.709426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f20c66-3725-476c-8407-d93400455790 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:20.718448 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f20c66-3725-476c-8407-d93400455790 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:20.724261 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decd864-fe0f-4c00-8349-2d1c70218627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:20.724916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decd864-fe0f-4c00-8349-2d1c70218627 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:20.725201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decd864-fe0f-4c00-8349-2d1c70218627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:20.725476 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decd864-fe0f-4c00-8349-2d1c70218627 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:20.726188 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decd864-fe0f-4c00-8349-2d1c70218627 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:20.726536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decd864-fe0f-4c00-8349-2d1c70218627 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:20.728122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decd864-fe0f-4c00-8349-2d1c70218627 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:20.733343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 475/928] 10.222.0.23 () {56 vars in 1147 bytes} [Thu Dec 9 00:57:20 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:20.740802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018e6d5-7072-4083-b6f2-39fee2812105 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:20.751480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018e6d5-7072-4083-b6f2-39fee2812105 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:20.756152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ede7f-1be2-4fd0-9c28-1633d60923b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:20.756801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ede7f-1be2-4fd0-9c28-1633d60923b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:20.757085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ede7f-1be2-4fd0-9c28-1633d60923b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:20.757357 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ede7f-1be2-4fd0-9c28-1633d60923b7 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:20.758075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ede7f-1be2-4fd0-9c28-1633d60923b7 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:20.758390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ede7f-1be2-4fd0-9c28-1633d60923b7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:20.760049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ede7f-1be2-4fd0-9c28-1633d60923b7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:20.765544 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 454/929] 10.222.0.23 () {56 vars in 1147 bytes} [Thu Dec 9 00:57:20 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:20.772312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decd864-fe0f-4c00-8349-2d1c70218627 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:20.783364 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decd864-fe0f-4c00-8349-2d1c70218627 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:20.787944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d3e85-2d3e-4a74-a845-ccf3a1e95e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:20.788587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d3e85-2d3e-4a74-a845-ccf3a1e95e8a admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:20.788867 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d3e85-2d3e-4a74-a845-ccf3a1e95e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:20.789142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d3e85-2d3e-4a74-a845-ccf3a1e95e8a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:20.789901 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d3e85-2d3e-4a74-a845-ccf3a1e95e8a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:20.791505 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d3e85-2d3e-4a74-a845-ccf3a1e95e8a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:20.818882 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 476/930] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Dec 9 00:57:20 2021] POST /identity/v3/endpoints => generated 347 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:21.002097 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127be3b7-6797-4ae7-b6b5-a26a5deadc34 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.002426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127be3b7-6797-4ae7-b6b5-a26a5deadc34 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.002587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127be3b7-6797-4ae7-b6b5-a26a5deadc34 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.004684 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 455/931] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:21.010970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e0472-cf2a-4844-92c4-e1d9e5aad963 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.011299 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e0472-cf2a-4844-92c4-e1d9e5aad963 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.011533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e0472-cf2a-4844-92c4-e1d9e5aad963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.030465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d76e0472-cf2a-4844-92c4-e1d9e5aad963 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:21.031822 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d76e0472-cf2a-4844-92c4-e1d9e5aad963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:21.050954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 477/932] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:21 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:21.075706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127be3b7-6797-4ae7-b6b5-a26a5deadc34 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:21.089411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127be3b7-6797-4ae7-b6b5-a26a5deadc34 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:21.094765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9ef8-fa07-4924-a423-6ef3676ab41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:21.095864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9ef8-fa07-4924-a423-6ef3676ab41f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.096405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9ef8-fa07-4924-a423-6ef3676ab41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.096936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9ef8-fa07-4924-a423-6ef3676ab41f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.108967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a9ef8-fa07-4924-a423-6ef3676ab41f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:21.117081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-1d9a9ef8-fa07-4924-a423-6ef3676ab41f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 09 00:57:21.118761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 456/933] 10.222.0.23 () {56 vars in 1141 bytes} [Thu Dec 9 00:57:21 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:21.125333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e0472-cf2a-4844-92c4-e1d9e5aad963 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:21.134836 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e0472-cf2a-4844-92c4-e1d9e5aad963 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:21.139673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344649ad-9fc2-4bf2-bb9b-6edb21aaeebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:21.140333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344649ad-9fc2-4bf2-bb9b-6edb21aaeebe admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.141134 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344649ad-9fc2-4bf2-bb9b-6edb21aaeebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.141423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344649ad-9fc2-4bf2-bb9b-6edb21aaeebe admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.142186 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344649ad-9fc2-4bf2-bb9b-6edb21aaeebe admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:21.142532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344649ad-9fc2-4bf2-bb9b-6edb21aaeebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:21.144118 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344649ad-9fc2-4bf2-bb9b-6edb21aaeebe admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:21.152964 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 478/934] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Dec 9 00:57:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:21.159997 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9ef8-fa07-4924-a423-6ef3676ab41f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:21.170029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9ef8-fa07-4924-a423-6ef3676ab41f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:21.174911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7af1e-65ec-49ac-8ada-1dfebb75d380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:21.175708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7af1e-65ec-49ac-8ada-1dfebb75d380 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.175995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7af1e-65ec-49ac-8ada-1dfebb75d380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.176273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7af1e-65ec-49ac-8ada-1dfebb75d380 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.187046 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7af1e-65ec-49ac-8ada-1dfebb75d380 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:21.189427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7af1e-65ec-49ac-8ada-1dfebb75d380 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:21.207168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-62e7af1e-65ec-49ac-8ada-1dfebb75d380 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:21.208652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 457/935] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:21.214741 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344649ad-9fc2-4bf2-bb9b-6edb21aaeebe admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:21.224781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344649ad-9fc2-4bf2-bb9b-6edb21aaeebe admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:21.229466 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11de01-44b9-4d18-9287-02b3989661bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:21.230126 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11de01-44b9-4d18-9287-02b3989661bb admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.230436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11de01-44b9-4d18-9287-02b3989661bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.230716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11de01-44b9-4d18-9287-02b3989661bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.231449 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11de01-44b9-4d18-9287-02b3989661bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:21.231755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11de01-44b9-4d18-9287-02b3989661bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:21.233343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11de01-44b9-4d18-9287-02b3989661bb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:21.246382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 479/936] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:21.254420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7af1e-65ec-49ac-8ada-1dfebb75d380 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:21.267335 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7af1e-65ec-49ac-8ada-1dfebb75d380 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:21.272121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac5f8-353b-4c68-bab4-31df292a43f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:21.272994 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac5f8-353b-4c68-bab4-31df292a43f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.273280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac5f8-353b-4c68-bab4-31df292a43f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.273558 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac5f8-353b-4c68-bab4-31df292a43f2 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.282489 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cac5f8-353b-4c68-bab4-31df292a43f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:21.284773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cac5f8-353b-4c68-bab4-31df292a43f2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:21.300748 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-53cac5f8-353b-4c68-bab4-31df292a43f2 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 09 00:57:21.302235 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 458/937] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Dec 9 00:57:21 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:21.308485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11de01-44b9-4d18-9287-02b3989661bb admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:21.318577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11de01-44b9-4d18-9287-02b3989661bb admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:21.323436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c0079-9842-46e7-b10c-38aad5d449e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:21.324147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c0079-9842-46e7-b10c-38aad5d449e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.324430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c0079-9842-46e7-b10c-38aad5d449e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.324708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c0079-9842-46e7-b10c-38aad5d449e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.325611 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c0079-9842-46e7-b10c-38aad5d449e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:21.325926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c0079-9842-46e7-b10c-38aad5d449e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:21.327852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c0079-9842-46e7-b10c-38aad5d449e6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:21.346391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 480/938] 10.222.0.23 () {56 vars in 1170 bytes} [Thu Dec 9 00:57:21 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:21.352510 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac5f8-353b-4c68-bab4-31df292a43f2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:21.363633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac5f8-353b-4c68-bab4-31df292a43f2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:21.368353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d910-0f57-494b-9b99-1dad043bc5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:21.369036 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d910-0f57-494b-9b99-1dad043bc5df admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.369322 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d910-0f57-494b-9b99-1dad043bc5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.369648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d910-0f57-494b-9b99-1dad043bc5df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.378427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d910-0f57-494b-9b99-1dad043bc5df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:21.380313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d910-0f57-494b-9b99-1dad043bc5df admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:21.390029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 459/939] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:21 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:57:21.396327 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c0079-9842-46e7-b10c-38aad5d449e6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:21.406837 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c0079-9842-46e7-b10c-38aad5d449e6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:21.411743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8f7a0-e206-4c01-917d-4d22c277f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:21.412585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8f7a0-e206-4c01-917d-4d22c277f35c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.412865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8f7a0-e206-4c01-917d-4d22c277f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.413193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8f7a0-e206-4c01-917d-4d22c277f35c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.425528 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8f7a0-e206-4c01-917d-4d22c277f35c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:21.427484 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8f7a0-e206-4c01-917d-4d22c277f35c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:21.445365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-0ca8f7a0-e206-4c01-917d-4d22c277f35c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:21.446921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 481/940] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:21.455697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d910-0f57-494b-9b99-1dad043bc5df admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:21.464791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d910-0f57-494b-9b99-1dad043bc5df admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:21.470097 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56657064-ae5b-4995-8258-df17d7867a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:21.470789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56657064-ae5b-4995-8258-df17d7867a0a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.471071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56657064-ae5b-4995-8258-df17d7867a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.471349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56657064-ae5b-4995-8258-df17d7867a0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.472078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56657064-ae5b-4995-8258-df17d7867a0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:21.472379 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56657064-ae5b-4995-8258-df17d7867a0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:21.474075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56657064-ae5b-4995-8258-df17d7867a0a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:21.486848 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 460/941] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:21.493131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8f7a0-e206-4c01-917d-4d22c277f35c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:21.504369 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8f7a0-e206-4c01-917d-4d22c277f35c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:21.513549 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf32d64-a653-45b8-af4f-72a6b810ef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:21.514301 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf32d64-a653-45b8-af4f-72a6b810ef77 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.514716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf32d64-a653-45b8-af4f-72a6b810ef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.514994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf32d64-a653-45b8-af4f-72a6b810ef77 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.523187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf32d64-a653-45b8-af4f-72a6b810ef77 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:21.524975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf32d64-a653-45b8-af4f-72a6b810ef77 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:21.542050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-9bf32d64-a653-45b8-af4f-72a6b810ef77 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:21.543598 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 482/942] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:21.550966 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56657064-ae5b-4995-8258-df17d7867a0a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:21.561235 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56657064-ae5b-4995-8258-df17d7867a0a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:21.582387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212ae2b-15fe-48e4-9d7a-b3758505d2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:21.582387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212ae2b-15fe-48e4-9d7a-b3758505d2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.582387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212ae2b-15fe-48e4-9d7a-b3758505d2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.582387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212ae2b-15fe-48e4-9d7a-b3758505d2d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.582752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212ae2b-15fe-48e4-9d7a-b3758505d2d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:21.582752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212ae2b-15fe-48e4-9d7a-b3758505d2d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:21.582752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212ae2b-15fe-48e4-9d7a-b3758505d2d2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:21.602400 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 461/943] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:21.608982 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf32d64-a653-45b8-af4f-72a6b810ef77 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:21.632964 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf32d64-a653-45b8-af4f-72a6b810ef77 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:21.646382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e62ef-1721-4065-8d2c-fcaf947b2032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:21.646382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e62ef-1721-4065-8d2c-fcaf947b2032 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:21.646382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e62ef-1721-4065-8d2c-fcaf947b2032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:21.646382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e62ef-1721-4065-8d2c-fcaf947b2032 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:21.646906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e62ef-1721-4065-8d2c-fcaf947b2032 admin admin] RBAC: Adding query filter params (role.id=a0c4d698c22c4b8e8a5d633ba758a5bb, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=7ccda27976ad40f2a62a50189f0fdc63) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:21.647224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e62ef-1721-4065-8d2c-fcaf947b2032 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:21.649059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e62ef-1721-4065-8d2c-fcaf947b2032 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:21.658350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 483/944] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:21 2021] GET /identity/v3/role_assignments?user.id=7ccda27976ad40f2a62a50189f0fdc63&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=a0c4d698c22c4b8e8a5d633ba758a5bb => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:22.319869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211516f-5a23-4a9f-af86-9d2d62552546 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:22.320386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211516f-5a23-4a9f-af86-9d2d62552546 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:22.320386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211516f-5a23-4a9f-af86-9d2d62552546 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:22.322417 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 462/945] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:22.328896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758584d2-90cd-46a5-9ca3-5d13cda68778 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:22.329337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758584d2-90cd-46a5-9ca3-5d13cda68778 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:22.329412 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758584d2-90cd-46a5-9ca3-5d13cda68778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:22.347370 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-758584d2-90cd-46a5-9ca3-5d13cda68778 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:22.348549 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-758584d2-90cd-46a5-9ca3-5d13cda68778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:22.356408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 484/946] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:22 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:22.379649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211516f-5a23-4a9f-af86-9d2d62552546 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:22.392802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211516f-5a23-4a9f-af86-9d2d62552546 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:22.397459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c4e52-16d6-4f9d-a156-e522a77fc653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:22.398266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c4e52-16d6-4f9d-a156-e522a77fc653 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:22.398578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c4e52-16d6-4f9d-a156-e522a77fc653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:22.398849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c4e52-16d6-4f9d-a156-e522a77fc653 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:22.399516 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c4e52-16d6-4f9d-a156-e522a77fc653 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:22.401130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c4e52-16d6-4f9d-a156-e522a77fc653 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:22.413294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-8d2c4e52-16d6-4f9d-a156-e522a77fc653 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 09 00:57:22.414877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 463/947] 10.222.0.23 () {56 vars in 1147 bytes} [Thu Dec 9 00:57:22 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:22.421485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758584d2-90cd-46a5-9ca3-5d13cda68778 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:22.435463 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758584d2-90cd-46a5-9ca3-5d13cda68778 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:22.441512 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ca9f7-89f7-4ec6-8863-d6651435b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:22.442171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ca9f7-89f7-4ec6-8863-d6651435b838 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:22.442542 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ca9f7-89f7-4ec6-8863-d6651435b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:22.442818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ca9f7-89f7-4ec6-8863-d6651435b838 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:22.443589 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ca9f7-89f7-4ec6-8863-d6651435b838 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:22.444025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ca9f7-89f7-4ec6-8863-d6651435b838 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:22.445622 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ca9f7-89f7-4ec6-8863-d6651435b838 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:22.457840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 485/948] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Dec 9 00:57:22 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:22.464118 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c4e52-16d6-4f9d-a156-e522a77fc653 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:22.475118 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c4e52-16d6-4f9d-a156-e522a77fc653 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:22.479732 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e982e-c16d-4c66-a57d-d083817c381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:22.480372 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e982e-c16d-4c66-a57d-d083817c381f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:22.480695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e982e-c16d-4c66-a57d-d083817c381f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:22.480969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e982e-c16d-4c66-a57d-d083817c381f admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:22.481685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e982e-c16d-4c66-a57d-d083817c381f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:22.481985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e982e-c16d-4c66-a57d-d083817c381f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:22.483659 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e982e-c16d-4c66-a57d-d083817c381f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:22.489722 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 464/949] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Dec 9 00:57:22 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:22.496102 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ca9f7-89f7-4ec6-8863-d6651435b838 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:22.506472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ca9f7-89f7-4ec6-8863-d6651435b838 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:22.510993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3664d5-c905-4e6b-894e-c223ab55b89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:22.511634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3664d5-c905-4e6b-894e-c223ab55b89f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:22.511914 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3664d5-c905-4e6b-894e-c223ab55b89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:22.512236 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3664d5-c905-4e6b-894e-c223ab55b89f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:22.513028 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3664d5-c905-4e6b-894e-c223ab55b89f admin admin] RBAC: Adding query filter params (interface=public, service_id=efb6b341877d48bc89011693b0f4a92c, region_id=RegionOne) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:22.513389 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3664d5-c905-4e6b-894e-c223ab55b89f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:22.515058 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3664d5-c905-4e6b-894e-c223ab55b89f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:22.521132 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 486/950] 10.222.0.23 () {56 vars in 1272 bytes} [Thu Dec 9 00:57:22 2021] GET /identity/v3/endpoints?service_id=efb6b341877d48bc89011693b0f4a92c&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:22.527152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e982e-c16d-4c66-a57d-d083817c381f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:22.538953 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e982e-c16d-4c66-a57d-d083817c381f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:22.543541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8c8f8-afbb-4232-aed8-adb9938f3f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:22.544182 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8c8f8-afbb-4232-aed8-adb9938f3f92 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:22.544500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8c8f8-afbb-4232-aed8-adb9938f3f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:22.544780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8c8f8-afbb-4232-aed8-adb9938f3f92 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:22.545459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8c8f8-afbb-4232-aed8-adb9938f3f92 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:22.547695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8c8f8-afbb-4232-aed8-adb9938f3f92 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:22.554037 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 465/951] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Dec 9 00:57:22 2021] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 00:57:22.836734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71850dbd-f68b-496d-a5fe-ba4df3cb4e50 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:22.836734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71850dbd-f68b-496d-a5fe-ba4df3cb4e50 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:22.836734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71850dbd-f68b-496d-a5fe-ba4df3cb4e50 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:22.836734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 487/952] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:22.844377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ad673-86ae-4767-b20f-06348fa9be7e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:22.844675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ad673-86ae-4767-b20f-06348fa9be7e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:22.844949 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ad673-86ae-4767-b20f-06348fa9be7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:22.866799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-629ad673-86ae-4767-b20f-06348fa9be7e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:22.867969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-629ad673-86ae-4767-b20f-06348fa9be7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:22.876312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 466/953] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:22 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:22.900825 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71850dbd-f68b-496d-a5fe-ba4df3cb4e50 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:22.914246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71850dbd-f68b-496d-a5fe-ba4df3cb4e50 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:22.919555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aec80-c6d0-4281-a6ba-dd968dc28d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:22.920575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aec80-c6d0-4281-a6ba-dd968dc28d67 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:22.921117 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aec80-c6d0-4281-a6ba-dd968dc28d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:22.921584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aec80-c6d0-4281-a6ba-dd968dc28d67 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:22.923079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92aec80-c6d0-4281-a6ba-dd968dc28d67 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:22.924898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92aec80-c6d0-4281-a6ba-dd968dc28d67 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:22.936892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-c92aec80-c6d0-4281-a6ba-dd968dc28d67 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 09 00:57:22.942485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 488/954] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:57:22 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:22.946545 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ad673-86ae-4767-b20f-06348fa9be7e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:22.956107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ad673-86ae-4767-b20f-06348fa9be7e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:22.960652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eee7e-a04b-4e7c-b89e-3647b77cee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:22.961305 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eee7e-a04b-4e7c-b89e-3647b77cee2d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:22.961587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eee7e-a04b-4e7c-b89e-3647b77cee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:22.961864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eee7e-a04b-4e7c-b89e-3647b77cee2d admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:22.962616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eee7e-a04b-4e7c-b89e-3647b77cee2d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:22.962919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eee7e-a04b-4e7c-b89e-3647b77cee2d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:22.964518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eee7e-a04b-4e7c-b89e-3647b77cee2d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:22.970349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 467/955] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:57:22 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:22.979723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aec80-c6d0-4281-a6ba-dd968dc28d67 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:22.991003 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aec80-c6d0-4281-a6ba-dd968dc28d67 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:22.995886 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e0145-bd29-4aa2-88be-3e8b6822557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:22.996892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e0145-bd29-4aa2-88be-3e8b6822557f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:22.997392 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e0145-bd29-4aa2-88be-3e8b6822557f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:22.997859 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e0145-bd29-4aa2-88be-3e8b6822557f admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:22.998838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e0145-bd29-4aa2-88be-3e8b6822557f admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:22.999336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e0145-bd29-4aa2-88be-3e8b6822557f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:23.001659 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e0145-bd29-4aa2-88be-3e8b6822557f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:23.012211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 489/956] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Dec 9 00:57:22 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:23.013750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eee7e-a04b-4e7c-b89e-3647b77cee2d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:23.024011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eee7e-a04b-4e7c-b89e-3647b77cee2d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:23.028984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea4c6c-ebde-4bd0-aead-884f1e307d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:23.029907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea4c6c-ebde-4bd0-aead-884f1e307d7e admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:23.030422 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea4c6c-ebde-4bd0-aead-884f1e307d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:23.030891 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea4c6c-ebde-4bd0-aead-884f1e307d7e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:23.032496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea4c6c-ebde-4bd0-aead-884f1e307d7e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:23.033699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-28ea4c6c-ebde-4bd0-aead-884f1e307d7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:57:23.033699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:57:23.033699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:57:23.035076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea4c6c-ebde-4bd0-aead-884f1e307d7e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:23.062540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 468/957] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Dec 9 00:57:23 2021] POST /identity/v3/endpoints => generated 346 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:23.532654 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab75d3-e1bd-41f6-8f2b-7820d39c8307 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:23.533195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab75d3-e1bd-41f6-8f2b-7820d39c8307 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:23.533195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab75d3-e1bd-41f6-8f2b-7820d39c8307 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:23.535225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 490/958] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:23.540985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3fc7f-a6c3-46d9-93be-df7d38629bab None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:23.541370 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3fc7f-a6c3-46d9-93be-df7d38629bab None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:23.541548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3fc7f-a6c3-46d9-93be-df7d38629bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:23.559298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-61d3fc7f-a6c3-46d9-93be-df7d38629bab None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:23.560475 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-61d3fc7f-a6c3-46d9-93be-df7d38629bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:23.577749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 469/959] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:23 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:23.600739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab75d3-e1bd-41f6-8f2b-7820d39c8307 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:23.613382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab75d3-e1bd-41f6-8f2b-7820d39c8307 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:23.617786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9a7eb-f9d3-4616-adfe-e4a2f76007bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:23.618577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a7eb-f9d3-4616-adfe-e4a2f76007bd admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:23.618858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a7eb-f9d3-4616-adfe-e4a2f76007bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:23.619130 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a7eb-f9d3-4616-adfe-e4a2f76007bd admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:23.619782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9a7eb-f9d3-4616-adfe-e4a2f76007bd admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:23.621354 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9a7eb-f9d3-4616-adfe-e4a2f76007bd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:23.632561 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-36f9a7eb-f9d3-4616-adfe-e4a2f76007bd admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 09 00:57:23.633995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 491/960] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:23 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:23.640346 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3fc7f-a6c3-46d9-93be-df7d38629bab None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:23.650929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3fc7f-a6c3-46d9-93be-df7d38629bab None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:23.656000 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05787b4e-d73e-4c34-ace0-7243ec3bc535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:23.656837 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05787b4e-d73e-4c34-ace0-7243ec3bc535 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:23.657123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05787b4e-d73e-4c34-ace0-7243ec3bc535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:23.657400 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05787b4e-d73e-4c34-ace0-7243ec3bc535 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:23.658119 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05787b4e-d73e-4c34-ace0-7243ec3bc535 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:23.658456 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05787b4e-d73e-4c34-ace0-7243ec3bc535 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:23.660061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05787b4e-d73e-4c34-ace0-7243ec3bc535 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:23.665351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 470/961] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:23 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:23.671085 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9a7eb-f9d3-4616-adfe-e4a2f76007bd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:23.682201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9a7eb-f9d3-4616-adfe-e4a2f76007bd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:23.686938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484b2e5-6974-4ca6-9966-5d50c3c4153d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:23.688286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484b2e5-6974-4ca6-9966-5d50c3c4153d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:23.688675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484b2e5-6974-4ca6-9966-5d50c3c4153d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:23.688954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484b2e5-6974-4ca6-9966-5d50c3c4153d admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:23.689711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484b2e5-6974-4ca6-9966-5d50c3c4153d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:23.690017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484b2e5-6974-4ca6-9966-5d50c3c4153d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:23.691672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484b2e5-6974-4ca6-9966-5d50c3c4153d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:23.696704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 492/962] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:23 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:24.286428 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b69b3-a5ac-432e-af36-d26e617b12cc None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:24.287097 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b69b3-a5ac-432e-af36-d26e617b12cc None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:24.287762 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b69b3-a5ac-432e-af36-d26e617b12cc None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:24.290769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 471/963] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:24 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:24.297494 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba12bc5-8bb5-4022-94d1-411d8745f944 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:24.297922 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba12bc5-8bb5-4022-94d1-411d8745f944 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:24.298301 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba12bc5-8bb5-4022-94d1-411d8745f944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:24.315521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-8ba12bc5-8bb5-4022-94d1-411d8745f944 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:24.316715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-8ba12bc5-8bb5-4022-94d1-411d8745f944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:24.324738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 493/964] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:24 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:24.348074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b69b3-a5ac-432e-af36-d26e617b12cc None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:24.360862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b69b3-a5ac-432e-af36-d26e617b12cc None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:24.365506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbb868-e556-4aa7-bd8d-34c89c8a5f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:24.366280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbb868-e556-4aa7-bd8d-34c89c8a5f64 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:24.366590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbb868-e556-4aa7-bd8d-34c89c8a5f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:24.366862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbb868-e556-4aa7-bd8d-34c89c8a5f64 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:24.367523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbb868-e556-4aa7-bd8d-34c89c8a5f64 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:24.369126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbb868-e556-4aa7-bd8d-34c89c8a5f64 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:24.380203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-61fbb868-e556-4aa7-bd8d-34c89c8a5f64 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 09 00:57:24.381650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 472/965] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Dec 9 00:57:24 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:24.388088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba12bc5-8bb5-4022-94d1-411d8745f944 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:24.397267 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba12bc5-8bb5-4022-94d1-411d8745f944 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:24.401893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fe7a7-0283-4ea9-b435-e3f1b2ed7b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:24.402576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fe7a7-0283-4ea9-b435-e3f1b2ed7b2e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:24.402859 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fe7a7-0283-4ea9-b435-e3f1b2ed7b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:24.403130 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fe7a7-0283-4ea9-b435-e3f1b2ed7b2e admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:24.403845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fe7a7-0283-4ea9-b435-e3f1b2ed7b2e admin admin] RBAC: Adding query filter params (name=image) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:24.404148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fe7a7-0283-4ea9-b435-e3f1b2ed7b2e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:24.405726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fe7a7-0283-4ea9-b435-e3f1b2ed7b2e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:24.411701 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 494/966] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:24 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:24.417659 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbb868-e556-4aa7-bd8d-34c89c8a5f64 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:24.427609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbb868-e556-4aa7-bd8d-34c89c8a5f64 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:24.432484 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf55506-9408-40f2-b93a-496a14fba348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:24.433128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf55506-9408-40f2-b93a-496a14fba348 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:24.433409 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf55506-9408-40f2-b93a-496a14fba348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:24.433682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf55506-9408-40f2-b93a-496a14fba348 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:24.434422 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf55506-9408-40f2-b93a-496a14fba348 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:24.434728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf55506-9408-40f2-b93a-496a14fba348 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:24.436309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf55506-9408-40f2-b93a-496a14fba348 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:24.444549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 473/967] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:24 2021] GET /identity/v3/services?type=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:25.099096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f3650-5cbf-4204-a214-de6edf4ecb46 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:25.099817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f3650-5cbf-4204-a214-de6edf4ecb46 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:25.099817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f3650-5cbf-4204-a214-de6edf4ecb46 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:25.101634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 495/968] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:25.107671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c53972-e2e8-4cc2-969e-e38a157a7695 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:25.108146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c53972-e2e8-4cc2-969e-e38a157a7695 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:25.108294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c53972-e2e8-4cc2-969e-e38a157a7695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:25.128748 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-78c53972-e2e8-4cc2-969e-e38a157a7695 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:25.129957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-78c53972-e2e8-4cc2-969e-e38a157a7695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:25.138285 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 474/969] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:25 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:25.164271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f3650-5cbf-4204-a214-de6edf4ecb46 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:25.177408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f3650-5cbf-4204-a214-de6edf4ecb46 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:25.181812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e981c29-f5bf-4688-989e-d86c6303738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:25.182647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e981c29-f5bf-4688-989e-d86c6303738c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:25.182927 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e981c29-f5bf-4688-989e-d86c6303738c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:25.183203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e981c29-f5bf-4688-989e-d86c6303738c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:25.183859 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e981c29-f5bf-4688-989e-d86c6303738c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:25.185424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e981c29-f5bf-4688-989e-d86c6303738c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:25.197853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-1e981c29-f5bf-4688-989e-d86c6303738c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 09 00:57:25.199356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 496/970] 10.222.0.23 () {56 vars in 1147 bytes} [Thu Dec 9 00:57:25 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:25.206533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c53972-e2e8-4cc2-969e-e38a157a7695 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:25.215502 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c53972-e2e8-4cc2-969e-e38a157a7695 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:25.221273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9cd07-814c-4577-8a6f-0d9a738cca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:25.221984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9cd07-814c-4577-8a6f-0d9a738cca78 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:25.222268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9cd07-814c-4577-8a6f-0d9a738cca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:25.222571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9cd07-814c-4577-8a6f-0d9a738cca78 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:25.223296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9cd07-814c-4577-8a6f-0d9a738cca78 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:25.223657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9cd07-814c-4577-8a6f-0d9a738cca78 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:25.225267 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9cd07-814c-4577-8a6f-0d9a738cca78 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:25.230385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 475/971] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Dec 9 00:57:25 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:25.237231 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e981c29-f5bf-4688-989e-d86c6303738c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:25.247108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e981c29-f5bf-4688-989e-d86c6303738c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:25.252817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cb96d-d3ac-4e47-b0c8-d3437091ca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:25.253474 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cb96d-d3ac-4e47-b0c8-d3437091ca33 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:25.253754 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cb96d-d3ac-4e47-b0c8-d3437091ca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:25.254028 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cb96d-d3ac-4e47-b0c8-d3437091ca33 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:25.254787 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cb96d-d3ac-4e47-b0c8-d3437091ca33 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:25.255093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cb96d-d3ac-4e47-b0c8-d3437091ca33 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:25.256687 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cb96d-d3ac-4e47-b0c8-d3437091ca33 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:25.262185 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 497/972] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Dec 9 00:57:25 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:25.269015 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9cd07-814c-4577-8a6f-0d9a738cca78 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:25.278640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9cd07-814c-4577-8a6f-0d9a738cca78 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:25.284375 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357f5bc-b7d6-4295-82a1-2371b9eb2523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:25.285016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357f5bc-b7d6-4295-82a1-2371b9eb2523 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:25.285297 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357f5bc-b7d6-4295-82a1-2371b9eb2523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:25.285567 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357f5bc-b7d6-4295-82a1-2371b9eb2523 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:25.286324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357f5bc-b7d6-4295-82a1-2371b9eb2523 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:25.287949 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357f5bc-b7d6-4295-82a1-2371b9eb2523 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:25.308442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 476/973] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Dec 9 00:57:25 2021] POST /identity/v3/endpoints => generated 349 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:25.560201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cf503-ec2f-4db7-b9ab-ace62380cc5e None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:25.560592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cf503-ec2f-4db7-b9ab-ace62380cc5e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:25.560780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cf503-ec2f-4db7-b9ab-ace62380cc5e None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:25.563117 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 498/974] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:25.568857 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801bb6b-5edf-4928-9626-c4bb842238c5 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:25.569348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801bb6b-5edf-4928-9626-c4bb842238c5 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:25.569520 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801bb6b-5edf-4928-9626-c4bb842238c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:25.591312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-8801bb6b-5edf-4928-9626-c4bb842238c5 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:25.592564 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8801bb6b-5edf-4928-9626-c4bb842238c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:25.612876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 477/975] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:25 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:25.637472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cf503-ec2f-4db7-b9ab-ace62380cc5e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:25.650058 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cf503-ec2f-4db7-b9ab-ace62380cc5e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:25.654851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d642427-572c-4122-81ac-702c6980f1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:25.655729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d642427-572c-4122-81ac-702c6980f1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:25.656336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d642427-572c-4122-81ac-702c6980f1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:25.656810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d642427-572c-4122-81ac-702c6980f1b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:25.657805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d642427-572c-4122-81ac-702c6980f1b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:25.659856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d642427-572c-4122-81ac-702c6980f1b3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:25.661492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.common [None req-4d642427-572c-4122-81ac-702c6980f1b3 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 09 00:57:25.680284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.sql.core [None req-4d642427-572c-4122-81ac-702c6980f1b3 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 09 00:57:25.680284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 09 00:57:25.680284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [parameters: {'id': 'aaf99722a32b4536bdf6484e8c92be37', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 09 00:57:25.680284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79331) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 09 00:57:25.697932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-4d642427-572c-4122-81ac-702c6980f1b3 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aaf99722a32b4536bdf6484e8c92be37.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aaf99722a32b4536bdf6484e8c92be37. Dec 09 00:57:25.706199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 499/976] 10.222.0.23 () {60 vars in 1161 bytes} [Thu Dec 9 00:57:25 2021] POST /identity/v3/projects => generated 262 bytes in 63 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:25.708164 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801bb6b-5edf-4928-9626-c4bb842238c5 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:25.717893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801bb6b-5edf-4928-9626-c4bb842238c5 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:25.723456 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924ef36-d48a-4231-9079-570ce935eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:25.724315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924ef36-d48a-4231-9079-570ce935eeae admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:25.724652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924ef36-d48a-4231-9079-570ce935eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:25.724986 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924ef36-d48a-4231-9079-570ce935eeae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:25.732556 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924ef36-d48a-4231-9079-570ce935eeae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:25.734688 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924ef36-d48a-4231-9079-570ce935eeae admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:25.748633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-4924ef36-d48a-4231-9079-570ce935eeae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:25.750967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 478/977] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:25.760071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d642427-572c-4122-81ac-702c6980f1b3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:25.771033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d642427-572c-4122-81ac-702c6980f1b3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:25.775955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c2a25-4d7a-41b6-be18-370c7f5fcc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:25.776918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c2a25-4d7a-41b6-be18-370c7f5fcc3e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:25.777505 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c2a25-4d7a-41b6-be18-370c7f5fcc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:25.777973 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c2a25-4d7a-41b6-be18-370c7f5fcc3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:25.778975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c2a25-4d7a-41b6-be18-370c7f5fcc3e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:25.779477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c2a25-4d7a-41b6-be18-370c7f5fcc3e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:25.782563 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c2a25-4d7a-41b6-be18-370c7f5fcc3e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:25.810626 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 500/978] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:25 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:26.106506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cc29e-0061-4807-8922-3ff8dea684ec None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:26.106697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cc29e-0061-4807-8922-3ff8dea684ec None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:26.106976 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cc29e-0061-4807-8922-3ff8dea684ec None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:26.108988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 479/979] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:26.115544 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b64cc-e6b9-4752-8cd4-c4b1cd9ef944 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:26.115948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b64cc-e6b9-4752-8cd4-c4b1cd9ef944 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:26.116142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b64cc-e6b9-4752-8cd4-c4b1cd9ef944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:26.134850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-939b64cc-e6b9-4752-8cd4-c4b1cd9ef944 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:26.136423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-939b64cc-e6b9-4752-8cd4-c4b1cd9ef944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:26.145429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 501/980] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:26 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:26.169381 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cc29e-0061-4807-8922-3ff8dea684ec None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:26.182488 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cc29e-0061-4807-8922-3ff8dea684ec None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:26.186960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07ba7d-34a5-44c1-b69d-c25cec137f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:26.187664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07ba7d-34a5-44c1-b69d-c25cec137f3b admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:26.187946 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07ba7d-34a5-44c1-b69d-c25cec137f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:26.188377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07ba7d-34a5-44c1-b69d-c25cec137f3b admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:26.189123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07ba7d-34a5-44c1-b69d-c25cec137f3b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:26.190742 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07ba7d-34a5-44c1-b69d-c25cec137f3b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:26.207715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 480/981] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:57:26 2021] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:26.839313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5373e-e632-4c5c-bc2f-eabc710c153a None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:26.839694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5373e-e632-4c5c-bc2f-eabc710c153a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:26.839890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5373e-e632-4c5c-bc2f-eabc710c153a None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:26.841675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 502/982] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:26.848431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1b39-dc38-4dda-82af-0a9801c1b895 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:26.848714 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1b39-dc38-4dda-82af-0a9801c1b895 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:26.848990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1b39-dc38-4dda-82af-0a9801c1b895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:26.870438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-dc9a1b39-dc38-4dda-82af-0a9801c1b895 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:26.871929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-dc9a1b39-dc38-4dda-82af-0a9801c1b895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:26.888464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 481/983] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:26 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:26.912777 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5373e-e632-4c5c-bc2f-eabc710c153a None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:26.925761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5373e-e632-4c5c-bc2f-eabc710c153a None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:26.930256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84306094-4586-46cc-9914-a3f939eb7ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:26.931001 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84306094-4586-46cc-9914-a3f939eb7ecf admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:26.931285 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84306094-4586-46cc-9914-a3f939eb7ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:26.931557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84306094-4586-46cc-9914-a3f939eb7ecf admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:26.932307 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84306094-4586-46cc-9914-a3f939eb7ecf admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:26.933915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84306094-4586-46cc-9914-a3f939eb7ecf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:26.949724 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 503/984] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:57:26 2021] POST /identity/v3/services => generated 242 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:27.811977 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55182a8-d63f-4b0c-a0aa-91073665f0bd None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:27.814116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55182a8-d63f-4b0c-a0aa-91073665f0bd None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:27.814653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55182a8-d63f-4b0c-a0aa-91073665f0bd None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:27.816900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 482/985] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:27.823518 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc42bc7-f4ed-4a5f-ab57-35d45748677d None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:27.824365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc42bc7-f4ed-4a5f-ab57-35d45748677d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:27.824845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc42bc7-f4ed-4a5f-ab57-35d45748677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:27.855432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2cc42bc7-f4ed-4a5f-ab57-35d45748677d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:27.857024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2cc42bc7-f4ed-4a5f-ab57-35d45748677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:27.882696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 504/986] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:27 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:27.903223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55182a8-d63f-4b0c-a0aa-91073665f0bd None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:27.917127 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55182a8-d63f-4b0c-a0aa-91073665f0bd None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:27.922599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdc59d-f7d9-494b-b26d-e02a05f35250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:27.923639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdc59d-f7d9-494b-b26d-e02a05f35250 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:27.924123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdc59d-f7d9-494b-b26d-e02a05f35250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:27.924596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdc59d-f7d9-494b-b26d-e02a05f35250 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:27.925455 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdc59d-f7d9-494b-b26d-e02a05f35250 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:27.927274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdc59d-f7d9-494b-b26d-e02a05f35250 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:27.940223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-4abdc59d-f7d9-494b-b26d-e02a05f35250 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 09 00:57:27.941906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 483/987] 10.222.0.23 () {56 vars in 1147 bytes} [Thu Dec 9 00:57:27 2021] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:27.948675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc42bc7-f4ed-4a5f-ab57-35d45748677d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:27.958551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc42bc7-f4ed-4a5f-ab57-35d45748677d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:27.963476 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6c2d7-782c-43a7-b601-34f1b179486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:27.964380 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c2d7-782c-43a7-b601-34f1b179486b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:27.964863 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c2d7-782c-43a7-b601-34f1b179486b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:27.965335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c2d7-782c-43a7-b601-34f1b179486b admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:27.966245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6c2d7-782c-43a7-b601-34f1b179486b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:27.966799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6c2d7-782c-43a7-b601-34f1b179486b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:27.969156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6c2d7-782c-43a7-b601-34f1b179486b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:27.975575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 505/988] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Dec 9 00:57:27 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:27.981951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdc59d-f7d9-494b-b26d-e02a05f35250 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:27.992994 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdc59d-f7d9-494b-b26d-e02a05f35250 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:27.998096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b7038-a623-49c3-ae6b-55aa5f3ece59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:27.998995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7038-a623-49c3-ae6b-55aa5f3ece59 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:27.999480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7038-a623-49c3-ae6b-55aa5f3ece59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.000881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7038-a623-49c3-ae6b-55aa5f3ece59 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.001845 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b7038-a623-49c3-ae6b-55aa5f3ece59 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:28.002446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b7038-a623-49c3-ae6b-55aa5f3ece59 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:28.004221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b7038-a623-49c3-ae6b-55aa5f3ece59 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:28.009954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 484/989] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Dec 9 00:57:27 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:28.017329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6c2d7-782c-43a7-b601-34f1b179486b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:28.027635 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6c2d7-782c-43a7-b601-34f1b179486b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:28.034037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63510f-29e3-4714-ad92-82a86bb13ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:28.034969 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63510f-29e3-4714-ad92-82a86bb13ece admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.035516 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63510f-29e3-4714-ad92-82a86bb13ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.036013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63510f-29e3-4714-ad92-82a86bb13ece admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.037081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63510f-29e3-4714-ad92-82a86bb13ece admin admin] RBAC: Adding query filter params (interface=admin, service_id=efb6b341877d48bc89011693b0f4a92c, region_id=RegionOne) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:28.037594 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63510f-29e3-4714-ad92-82a86bb13ece admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:28.039479 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63510f-29e3-4714-ad92-82a86bb13ece admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:28.045636 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 506/990] 10.222.0.23 () {56 vars in 1270 bytes} [Thu Dec 9 00:57:28 2021] GET /identity/v3/endpoints?service_id=efb6b341877d48bc89011693b0f4a92c&interface=admin®ion_id=RegionOne => generated 193 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:28.052845 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b7038-a623-49c3-ae6b-55aa5f3ece59 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:28.064434 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b7038-a623-49c3-ae6b-55aa5f3ece59 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:28.069562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667a7df-67d4-4168-a49c-2df659534940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:28.070515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667a7df-67d4-4168-a49c-2df659534940 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.071069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667a7df-67d4-4168-a49c-2df659534940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.071540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667a7df-67d4-4168-a49c-2df659534940 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.072491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667a7df-67d4-4168-a49c-2df659534940 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:28.074312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667a7df-67d4-4168-a49c-2df659534940 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:28.086503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 485/991] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Dec 9 00:57:28 2021] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 00:57:28.269993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f1027-101e-409d-9008-7cebc11515a4 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.270398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f1027-101e-409d-9008-7cebc11515a4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.270597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f1027-101e-409d-9008-7cebc11515a4 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.272699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 507/992] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:28.278852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdcb93-61f5-4304-8ac8-c2f825221f50 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.279144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdcb93-61f5-4304-8ac8-c2f825221f50 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.279408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdcb93-61f5-4304-8ac8-c2f825221f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.299010 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-94bdcb93-61f5-4304-8ac8-c2f825221f50 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:28.300226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-94bdcb93-61f5-4304-8ac8-c2f825221f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:28.310458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 486/993] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:28 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:28.335048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f1027-101e-409d-9008-7cebc11515a4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:28.348035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f1027-101e-409d-9008-7cebc11515a4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:28.352496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78868145-52b0-46a4-966e-64999d72b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:28.353148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78868145-52b0-46a4-966e-64999d72b2cf admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.353426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78868145-52b0-46a4-966e-64999d72b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.353694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78868145-52b0-46a4-966e-64999d72b2cf admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.354447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78868145-52b0-46a4-966e-64999d72b2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:28.356271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78868145-52b0-46a4-966e-64999d72b2cf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:28.370568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.sql.core [None req-78868145-52b0-46a4-966e-64999d72b2cf admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 09 00:57:28.370568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 09 00:57:28.370568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [parameters: {'user_id': '8c2254a089e84a21ba02b0e893ca755b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 09 00:57:28.370568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79331) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 09 00:57:28.377196 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-78868145-52b0-46a4-966e-64999d72b2cf admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 09 00:57:28.382509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 508/994] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 00:57:28 2021] POST /identity/v3/users => generated 160 bytes in 44 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:28.385663 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdcb93-61f5-4304-8ac8-c2f825221f50 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:28.395670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdcb93-61f5-4304-8ac8-c2f825221f50 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:28.400339 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e0085-a057-4116-8260-1248e55acfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:28.401125 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e0085-a057-4116-8260-1248e55acfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.401403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e0085-a057-4116-8260-1248e55acfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.401676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e0085-a057-4116-8260-1248e55acfa8 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.409493 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e0085-a057-4116-8260-1248e55acfa8 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:28.411558 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e0085-a057-4116-8260-1248e55acfa8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:28.426964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-535e0085-a057-4116-8260-1248e55acfa8 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 09 00:57:28.431556 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 487/995] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:57:28 2021] GET /identity/v3/users/cinder => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:28.435551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78868145-52b0-46a4-966e-64999d72b2cf admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:28.448877 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78868145-52b0-46a4-966e-64999d72b2cf admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:28.453906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652dd09-fdb4-4c5f-a543-9465a8d4c265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:28.454634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652dd09-fdb4-4c5f-a543-9465a8d4c265 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.454916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652dd09-fdb4-4c5f-a543-9465a8d4c265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.455237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652dd09-fdb4-4c5f-a543-9465a8d4c265 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.456105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652dd09-fdb4-4c5f-a543-9465a8d4c265 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:28.456409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652dd09-fdb4-4c5f-a543-9465a8d4c265 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:28.458542 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652dd09-fdb4-4c5f-a543-9465a8d4c265 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:28.499517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 509/996] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Dec 9 00:57:28 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:28.612842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a375d7-05e3-4025-afdb-0a89865260c5 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.613144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a375d7-05e3-4025-afdb-0a89865260c5 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.613807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a375d7-05e3-4025-afdb-0a89865260c5 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.615474 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 488/997] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:28.621720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a23597-20ac-4188-8356-519bdc1d2181 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.621998 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a23597-20ac-4188-8356-519bdc1d2181 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.622276 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a23597-20ac-4188-8356-519bdc1d2181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.646578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a7a23597-20ac-4188-8356-519bdc1d2181 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:28.648138 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a7a23597-20ac-4188-8356-519bdc1d2181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:28.657385 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 510/998] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:28 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:28.680379 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a375d7-05e3-4025-afdb-0a89865260c5 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:28.693650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a375d7-05e3-4025-afdb-0a89865260c5 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:28.698232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb1d5b-d3de-4e36-9722-7c9a70de3069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:28.699126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb1d5b-d3de-4e36-9722-7c9a70de3069 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.699405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb1d5b-d3de-4e36-9722-7c9a70de3069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.699677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb1d5b-d3de-4e36-9722-7c9a70de3069 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.700402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb1d5b-d3de-4e36-9722-7c9a70de3069 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:28.702122 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb1d5b-d3de-4e36-9722-7c9a70de3069 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:28.714132 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-f0cb1d5b-d3de-4e36-9722-7c9a70de3069 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 09 00:57:28.715662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 489/999] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:28 2021] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:28.722683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a23597-20ac-4188-8356-519bdc1d2181 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:28.731706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a23597-20ac-4188-8356-519bdc1d2181 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:28.737986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafc2ab-c40f-4106-804a-20da074ede69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:28.741968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc2ab-c40f-4106-804a-20da074ede69 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.741968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc2ab-c40f-4106-804a-20da074ede69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.741968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc2ab-c40f-4106-804a-20da074ede69 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.741968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafc2ab-c40f-4106-804a-20da074ede69 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:28.741968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafc2ab-c40f-4106-804a-20da074ede69 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:28.741968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafc2ab-c40f-4106-804a-20da074ede69 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:28.747745 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 511/1000] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:28 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:28.754301 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb1d5b-d3de-4e36-9722-7c9a70de3069 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:28.764304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb1d5b-d3de-4e36-9722-7c9a70de3069 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:28.770711 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68d704-5905-493e-a701-836a019ba3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:28.771356 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68d704-5905-493e-a701-836a019ba3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.771637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68d704-5905-493e-a701-836a019ba3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.771907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68d704-5905-493e-a701-836a019ba3e6 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.772618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68d704-5905-493e-a701-836a019ba3e6 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:28.772918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68d704-5905-493e-a701-836a019ba3e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:28.774975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68d704-5905-493e-a701-836a019ba3e6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:28.780050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 490/1001] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:28 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:28.786234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafc2ab-c40f-4106-804a-20da074ede69 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:28.796609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafc2ab-c40f-4106-804a-20da074ede69 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:28.804704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5747295-b28e-454e-96d3-5788cbc35a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:28.805361 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5747295-b28e-454e-96d3-5788cbc35a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.805637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5747295-b28e-454e-96d3-5788cbc35a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.805911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5747295-b28e-454e-96d3-5788cbc35a15 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.806743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5747295-b28e-454e-96d3-5788cbc35a15 admin admin] RBAC: Adding query filter params (interface=public, service_id=66f8da90436748fb82b3637d12afa77c, region_id=RegionOne) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:28.807052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5747295-b28e-454e-96d3-5788cbc35a15 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:28.808630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5747295-b28e-454e-96d3-5788cbc35a15 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:28.817683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 512/1002] 10.222.0.23 () {56 vars in 1272 bytes} [Thu Dec 9 00:57:28 2021] GET /identity/v3/endpoints?service_id=66f8da90436748fb82b3637d12afa77c&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:28.824050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68d704-5905-493e-a701-836a019ba3e6 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:28.835061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68d704-5905-493e-a701-836a019ba3e6 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:28.840171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defd8fd-f8c1-4bce-8e02-b248822bc2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:28.841180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defd8fd-f8c1-4bce-8e02-b248822bc2fb admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:28.841905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defd8fd-f8c1-4bce-8e02-b248822bc2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:28.842559 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defd8fd-f8c1-4bce-8e02-b248822bc2fb admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:28.843562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defd8fd-f8c1-4bce-8e02-b248822bc2fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:28.845991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defd8fd-f8c1-4bce-8e02-b248822bc2fb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:28.857847 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 491/1003] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Dec 9 00:57:28 2021] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 00:57:29.429032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4799bc-9df8-4d1d-8463-bde271130078 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:29.429570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4799bc-9df8-4d1d-8463-bde271130078 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:29.429570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4799bc-9df8-4d1d-8463-bde271130078 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:29.431401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 513/1004] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:29.437115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfc1d2-e0a9-4d89-a0b7-0a07c68daaf7 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:29.437439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfc1d2-e0a9-4d89-a0b7-0a07c68daaf7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:29.437716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfc1d2-e0a9-4d89-a0b7-0a07c68daaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:29.456182 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-2ecfc1d2-e0a9-4d89-a0b7-0a07c68daaf7 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:29.457349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2ecfc1d2-e0a9-4d89-a0b7-0a07c68daaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:29.464954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 492/1005] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:29 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:29.490033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4799bc-9df8-4d1d-8463-bde271130078 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:29.502643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4799bc-9df8-4d1d-8463-bde271130078 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:29.506914 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb801c-7df2-4628-aced-a3f27225444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:29.507680 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb801c-7df2-4628-aced-a3f27225444f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:29.507964 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb801c-7df2-4628-aced-a3f27225444f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:29.508241 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb801c-7df2-4628-aced-a3f27225444f admin admin] PATH_INFO: `/v3/services/image` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:29.508898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb801c-7df2-4628-aced-a3f27225444f admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:29.510503 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb801c-7df2-4628-aced-a3f27225444f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:29.521133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-a5cb801c-7df2-4628-aced-a3f27225444f admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 09 00:57:29.522515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 514/1006] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Dec 9 00:57:29 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:29.528679 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfc1d2-e0a9-4d89-a0b7-0a07c68daaf7 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:29.538546 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfc1d2-e0a9-4d89-a0b7-0a07c68daaf7 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:29.543154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b094da-3263-46bb-847d-86c28237043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:29.544023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b094da-3263-46bb-847d-86c28237043a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:29.544488 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b094da-3263-46bb-847d-86c28237043a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:29.544936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b094da-3263-46bb-847d-86c28237043a admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:29.545870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b094da-3263-46bb-847d-86c28237043a admin admin] RBAC: Adding query filter params (name=image) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:29.546359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b094da-3263-46bb-847d-86c28237043a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:29.548847 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b094da-3263-46bb-847d-86c28237043a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:29.554529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 493/1007] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:29 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:29.560335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb801c-7df2-4628-aced-a3f27225444f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:29.570004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb801c-7df2-4628-aced-a3f27225444f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:29.574445 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46565-1922-40cb-8f3a-e677b721132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:29.575090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46565-1922-40cb-8f3a-e677b721132f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:29.575375 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46565-1922-40cb-8f3a-e677b721132f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:29.575652 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46565-1922-40cb-8f3a-e677b721132f admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:29.576364 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac46565-1922-40cb-8f3a-e677b721132f admin admin] RBAC: Adding query filter params (type=image) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:29.576670 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac46565-1922-40cb-8f3a-e677b721132f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:29.578280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac46565-1922-40cb-8f3a-e677b721132f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:29.583535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 515/1008] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:29 2021] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:29.589535 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b094da-3263-46bb-847d-86c28237043a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:29.601293 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b094da-3263-46bb-847d-86c28237043a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:29.605952 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42757e51-7469-4308-b292-8de32541cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:29.606857 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757e51-7469-4308-b292-8de32541cef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:29.607338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757e51-7469-4308-b292-8de32541cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:29.607830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757e51-7469-4308-b292-8de32541cef2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:29.608820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42757e51-7469-4308-b292-8de32541cef2 admin admin] RBAC: Adding query filter params (interface=public, service_id=f66e7240ba17486c8863d012dca034c0, region_id=RegionOne) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:29.609450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42757e51-7469-4308-b292-8de32541cef2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:29.611527 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42757e51-7469-4308-b292-8de32541cef2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:29.617308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 494/1009] 10.222.0.23 () {56 vars in 1272 bytes} [Thu Dec 9 00:57:29 2021] GET /identity/v3/endpoints?service_id=f66e7240ba17486c8863d012dca034c0&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:29.622981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46565-1922-40cb-8f3a-e677b721132f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:29.633467 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46565-1922-40cb-8f3a-e677b721132f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:29.638043 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429440c-2471-46d0-950a-78fa01c9e23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:29.638722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429440c-2471-46d0-950a-78fa01c9e23f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:29.639008 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429440c-2471-46d0-950a-78fa01c9e23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:29.639283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429440c-2471-46d0-950a-78fa01c9e23f admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:29.639970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429440c-2471-46d0-950a-78fa01c9e23f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:29.641594 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429440c-2471-46d0-950a-78fa01c9e23f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:29.648305 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 516/1010] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Dec 9 00:57:29 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 00:57:30.575503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a068788-d44f-4e3b-93fc-323ce403f91a None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:30.576022 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a068788-d44f-4e3b-93fc-323ce403f91a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:30.576102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a068788-d44f-4e3b-93fc-323ce403f91a None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:30.577967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 495/1011] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:30.583674 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea985a0-b224-4422-9e3a-31711769bd48 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:30.584051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea985a0-b224-4422-9e3a-31711769bd48 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:30.584226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea985a0-b224-4422-9e3a-31711769bd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:30.602507 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-5ea985a0-b224-4422-9e3a-31711769bd48 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:30.603695 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5ea985a0-b224-4422-9e3a-31711769bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:30.612509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 517/1012] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:30 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:30.639206 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a068788-d44f-4e3b-93fc-323ce403f91a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:30.651607 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a068788-d44f-4e3b-93fc-323ce403f91a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:30.655798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc30fa-2ac9-45cc-b0ab-36fd13ab6164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:30.657191 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc30fa-2ac9-45cc-b0ab-36fd13ab6164 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:30.657468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc30fa-2ac9-45cc-b0ab-36fd13ab6164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:30.657736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc30fa-2ac9-45cc-b0ab-36fd13ab6164 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:30.658405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc30fa-2ac9-45cc-b0ab-36fd13ab6164 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:30.659976 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc30fa-2ac9-45cc-b0ab-36fd13ab6164 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:30.670753 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-3ddc30fa-2ac9-45cc-b0ab-36fd13ab6164 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 09 00:57:30.672242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 496/1013] 10.222.0.23 () {56 vars in 1147 bytes} [Thu Dec 9 00:57:30 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:30.678406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea985a0-b224-4422-9e3a-31711769bd48 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:30.687365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea985a0-b224-4422-9e3a-31711769bd48 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:30.691750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cab45-0c8c-4d3a-8450-9b8454bb1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:30.692402 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cab45-0c8c-4d3a-8450-9b8454bb1859 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:30.692683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cab45-0c8c-4d3a-8450-9b8454bb1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:30.692957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cab45-0c8c-4d3a-8450-9b8454bb1859 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:30.693671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cab45-0c8c-4d3a-8450-9b8454bb1859 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:30.693973 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cab45-0c8c-4d3a-8450-9b8454bb1859 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:30.695601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cab45-0c8c-4d3a-8450-9b8454bb1859 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:30.700588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 518/1014] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Dec 9 00:57:30 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:30.707124 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc30fa-2ac9-45cc-b0ab-36fd13ab6164 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:30.716726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc30fa-2ac9-45cc-b0ab-36fd13ab6164 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:30.722175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d8249-e4f8-4ed5-8ebe-788b780d25cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:30.722852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d8249-e4f8-4ed5-8ebe-788b780d25cb admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:30.723130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d8249-e4f8-4ed5-8ebe-788b780d25cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:30.723400 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d8249-e4f8-4ed5-8ebe-788b780d25cb admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:30.724106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d8249-e4f8-4ed5-8ebe-788b780d25cb admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:30.724407 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d8249-e4f8-4ed5-8ebe-788b780d25cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:30.725981 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d8249-e4f8-4ed5-8ebe-788b780d25cb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:30.731063 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 497/1015] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Dec 9 00:57:30 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:30.738284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cab45-0c8c-4d3a-8450-9b8454bb1859 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:30.747908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cab45-0c8c-4d3a-8450-9b8454bb1859 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:30.752734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2764c51-2472-4e59-9f4c-6c78e40f8cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:30.753453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2764c51-2472-4e59-9f4c-6c78e40f8cad admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:30.753739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2764c51-2472-4e59-9f4c-6c78e40f8cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:30.754017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2764c51-2472-4e59-9f4c-6c78e40f8cad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:30.754802 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2764c51-2472-4e59-9f4c-6c78e40f8cad admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:30.756393 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2764c51-2472-4e59-9f4c-6c78e40f8cad admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:30.772521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 519/1016] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Dec 9 00:57:30 2021] POST /identity/v3/endpoints => generated 325 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 00:57:31.252504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbea70a-2e9b-481c-b2a7-0bd1fea35276 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:31.252899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbea70a-2e9b-481c-b2a7-0bd1fea35276 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:31.253173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbea70a-2e9b-481c-b2a7-0bd1fea35276 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:31.255122 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 498/1017] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:31.260733 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f8e1e-e42b-40a7-8cd4-393ca39d403c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:31.261019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f8e1e-e42b-40a7-8cd4-393ca39d403c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:31.261289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f8e1e-e42b-40a7-8cd4-393ca39d403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:31.278966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-eb8f8e1e-e42b-40a7-8cd4-393ca39d403c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:31.280153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-eb8f8e1e-e42b-40a7-8cd4-393ca39d403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:31.297034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 520/1018] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:31 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:31.320820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbea70a-2e9b-481c-b2a7-0bd1fea35276 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:31.333083 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbea70a-2e9b-481c-b2a7-0bd1fea35276 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:31.337437 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fd157-bd8f-4940-9d54-bd812fdf22ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:31.338204 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fd157-bd8f-4940-9d54-bd812fdf22ab admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:31.338514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fd157-bd8f-4940-9d54-bd812fdf22ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:31.338790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fd157-bd8f-4940-9d54-bd812fdf22ab admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:31.339444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fd157-bd8f-4940-9d54-bd812fdf22ab admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:31.341012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fd157-bd8f-4940-9d54-bd812fdf22ab admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:31.351590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-b90fd157-bd8f-4940-9d54-bd812fdf22ab admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 09 00:57:31.352842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 499/1019] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:31 2021] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:31.359710 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f8e1e-e42b-40a7-8cd4-393ca39d403c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:31.368754 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f8e1e-e42b-40a7-8cd4-393ca39d403c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:31.373190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a095ae-ef7f-493f-be68-edd719168759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:31.373903 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a095ae-ef7f-493f-be68-edd719168759 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:31.374253 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a095ae-ef7f-493f-be68-edd719168759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:31.375231 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a095ae-ef7f-493f-be68-edd719168759 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:31.376079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a095ae-ef7f-493f-be68-edd719168759 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:31.376452 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a095ae-ef7f-493f-be68-edd719168759 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:31.378096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a095ae-ef7f-493f-be68-edd719168759 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:31.382986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 521/1020] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:31 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:31.388544 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fd157-bd8f-4940-9d54-bd812fdf22ab admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:31.398707 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fd157-bd8f-4940-9d54-bd812fdf22ab admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:31.403161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68d002-40ce-47ca-bd12-60f324d2cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:31.403793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68d002-40ce-47ca-bd12-60f324d2cd54 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:31.404073 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68d002-40ce-47ca-bd12-60f324d2cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:31.404349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68d002-40ce-47ca-bd12-60f324d2cd54 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:31.405059 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68d002-40ce-47ca-bd12-60f324d2cd54 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:31.405363 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68d002-40ce-47ca-bd12-60f324d2cd54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:31.407075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68d002-40ce-47ca-bd12-60f324d2cd54 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:31.411890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 500/1021] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Dec 9 00:57:31 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:31.417812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a095ae-ef7f-493f-be68-edd719168759 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:31.427840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a095ae-ef7f-493f-be68-edd719168759 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:31.432399 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c11e28-3237-4269-aeb1-e495e53a6e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:31.433114 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c11e28-3237-4269-aeb1-e495e53a6e81 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:31.433508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c11e28-3237-4269-aeb1-e495e53a6e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:31.433786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c11e28-3237-4269-aeb1-e495e53a6e81 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:31.434568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c11e28-3237-4269-aeb1-e495e53a6e81 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:31.436292 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c11e28-3237-4269-aeb1-e495e53a6e81 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:31.455459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 522/1022] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Dec 9 00:57:31 2021] POST /identity/v3/endpoints => generated 334 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:32.133363 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ba13-e452-4828-8518-333390573538 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:32.133893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ba13-e452-4828-8518-333390573538 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:32.133893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ba13-e452-4828-8518-333390573538 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:32.135747 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 501/1023] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:32.142326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fba07-4f36-46b6-8159-32307fec7abd None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:32.142784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fba07-4f36-46b6-8159-32307fec7abd None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:32.142953 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fba07-4f36-46b6-8159-32307fec7abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:32.160905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-212fba07-4f36-46b6-8159-32307fec7abd None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:32.162160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-212fba07-4f36-46b6-8159-32307fec7abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:32.179763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 523/1024] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:32 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:32.210923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1ba13-e452-4828-8518-333390573538 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:32.227016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1ba13-e452-4828-8518-333390573538 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:32.231442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7245fe-11ec-4d76-86ff-07bc1c845172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:32.232214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7245fe-11ec-4d76-86ff-07bc1c845172 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:32.232496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7245fe-11ec-4d76-86ff-07bc1c845172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:32.232771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7245fe-11ec-4d76-86ff-07bc1c845172 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:32.233459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7245fe-11ec-4d76-86ff-07bc1c845172 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:32.235155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7245fe-11ec-4d76-86ff-07bc1c845172 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:32.246531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-7d7245fe-11ec-4d76-86ff-07bc1c845172 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 09 00:57:32.247912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 502/1025] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Dec 9 00:57:32 2021] GET /identity/v3/services/image => generated 86 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:32.254391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fba07-4f36-46b6-8159-32307fec7abd None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:32.263498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fba07-4f36-46b6-8159-32307fec7abd None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:32.268957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ffaac-4350-49e0-8a41-6d8c9084d508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:32.269698 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ffaac-4350-49e0-8a41-6d8c9084d508 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:32.270042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ffaac-4350-49e0-8a41-6d8c9084d508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:32.270422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ffaac-4350-49e0-8a41-6d8c9084d508 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:32.271213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ffaac-4350-49e0-8a41-6d8c9084d508 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:32.271586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ffaac-4350-49e0-8a41-6d8c9084d508 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:32.273239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ffaac-4350-49e0-8a41-6d8c9084d508 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:32.278291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 524/1026] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:32 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:32.285238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7245fe-11ec-4d76-86ff-07bc1c845172 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:32.294907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7245fe-11ec-4d76-86ff-07bc1c845172 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:32.299515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39ac33-4d88-4a8a-afbf-211c7e851e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:32.300175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39ac33-4d88-4a8a-afbf-211c7e851e25 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:32.300444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39ac33-4d88-4a8a-afbf-211c7e851e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:32.300722 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39ac33-4d88-4a8a-afbf-211c7e851e25 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:32.301431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39ac33-4d88-4a8a-afbf-211c7e851e25 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:32.301740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39ac33-4d88-4a8a-afbf-211c7e851e25 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:32.303349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39ac33-4d88-4a8a-afbf-211c7e851e25 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:32.308240 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 503/1027] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:32 2021] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:32.314098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ffaac-4350-49e0-8a41-6d8c9084d508 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:32.323818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ffaac-4350-49e0-8a41-6d8c9084d508 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:32.329395 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3c770-4c63-47ef-84a6-463f90b78f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:32.330097 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3c770-4c63-47ef-84a6-463f90b78f1b admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:32.330405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3c770-4c63-47ef-84a6-463f90b78f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:32.330700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3c770-4c63-47ef-84a6-463f90b78f1b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:32.331441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3c770-4c63-47ef-84a6-463f90b78f1b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:32.333008 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3c770-4c63-47ef-84a6-463f90b78f1b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:32.353667 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 525/1028] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Dec 9 00:57:32 2021] POST /identity/v3/endpoints => generated 327 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 00:57:33.189216 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766bfe-b62b-43df-8179-807c2aab1ea0 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:33.189717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766bfe-b62b-43df-8179-807c2aab1ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:33.189717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766bfe-b62b-43df-8179-807c2aab1ea0 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:33.191628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 504/1029] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:33.197096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89208623-aedd-4c21-8010-396b02160878 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:33.197483 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89208623-aedd-4c21-8010-396b02160878 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:33.197660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89208623-aedd-4c21-8010-396b02160878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:33.217377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-89208623-aedd-4c21-8010-396b02160878 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:33.219555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-89208623-aedd-4c21-8010-396b02160878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:33.237551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 526/1030] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:33.262038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766bfe-b62b-43df-8179-807c2aab1ea0 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:33.273976 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766bfe-b62b-43df-8179-807c2aab1ea0 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:33.278261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf967f-9078-4c41-b444-9c16b9a6440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:33.279125 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf967f-9078-4c41-b444-9c16b9a6440c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:33.279405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf967f-9078-4c41-b444-9c16b9a6440c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:33.279671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf967f-9078-4c41-b444-9c16b9a6440c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:33.281453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf967f-9078-4c41-b444-9c16b9a6440c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:33.283146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf967f-9078-4c41-b444-9c16b9a6440c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:33.284833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 505/1031] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:33.291020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89208623-aedd-4c21-8010-396b02160878 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:33.300647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89208623-aedd-4c21-8010-396b02160878 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:33.305296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dfd23-834b-4702-9a57-d22774a76d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:33.305941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dfd23-834b-4702-9a57-d22774a76d97 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:33.306223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dfd23-834b-4702-9a57-d22774a76d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:33.306530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dfd23-834b-4702-9a57-d22774a76d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:33.307263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dfd23-834b-4702-9a57-d22774a76d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:33.309156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dfd23-834b-4702-9a57-d22774a76d97 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:33.335042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 527/1032] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:57:33 2021] POST /identity/v3/projects => generated 311 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 00:57:33.957712 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a067dc6-a160-4f3d-9602-3017d3535451 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:33.958070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a067dc6-a160-4f3d-9602-3017d3535451 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:33.958266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a067dc6-a160-4f3d-9602-3017d3535451 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:33.960200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 506/1033] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:33.965696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7bb08-5ef2-40dd-9a29-7a1e3da5614e None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:33.965995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7bb08-5ef2-40dd-9a29-7a1e3da5614e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:33.966277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7bb08-5ef2-40dd-9a29-7a1e3da5614e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:33.985021 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-84a7bb08-5ef2-40dd-9a29-7a1e3da5614e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:33.986563 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-84a7bb08-5ef2-40dd-9a29-7a1e3da5614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:34.041482 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 528/1034] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:34.066656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a067dc6-a160-4f3d-9602-3017d3535451 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.078939 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a067dc6-a160-4f3d-9602-3017d3535451 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.083273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eb38c-3022-4e6a-8a9e-cd994656cb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.084060 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eb38c-3022-4e6a-8a9e-cd994656cb5d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.084344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eb38c-3022-4e6a-8a9e-cd994656cb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.084617 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eb38c-3022-4e6a-8a9e-cd994656cb5d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.095665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558eb38c-3022-4e6a-8a9e-cd994656cb5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:34.103031 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-558eb38c-3022-4e6a-8a9e-cd994656cb5d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 09 00:57:34.104309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 507/1035] 10.222.0.23 () {56 vars in 1141 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:34.110583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7bb08-5ef2-40dd-9a29-7a1e3da5614e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.119778 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7bb08-5ef2-40dd-9a29-7a1e3da5614e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.125056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb137f-8b9a-4176-b649-7e4a2b4f5d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.125801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb137f-8b9a-4176-b649-7e4a2b4f5d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.126086 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb137f-8b9a-4176-b649-7e4a2b4f5d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.126387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb137f-8b9a-4176-b649-7e4a2b4f5d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.127150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb137f-8b9a-4176-b649-7e4a2b4f5d96 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:34.127457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb137f-8b9a-4176-b649-7e4a2b4f5d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.129052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb137f-8b9a-4176-b649-7e4a2b4f5d96 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.137524 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 529/1036] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:34.143643 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eb38c-3022-4e6a-8a9e-cd994656cb5d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.153668 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eb38c-3022-4e6a-8a9e-cd994656cb5d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.158989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fcdd9-cb06-4d87-9797-f00e50716a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.159893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fcdd9-cb06-4d87-9797-f00e50716a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.160297 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fcdd9-cb06-4d87-9797-f00e50716a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.160673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fcdd9-cb06-4d87-9797-f00e50716a65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.171152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fcdd9-cb06-4d87-9797-f00e50716a65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.173695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fcdd9-cb06-4d87-9797-f00e50716a65 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.190223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-406fcdd9-cb06-4d87-9797-f00e50716a65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:34.196215 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 508/1037] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:34.197907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb137f-8b9a-4176-b649-7e4a2b4f5d96 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.208067 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb137f-8b9a-4176-b649-7e4a2b4f5d96 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.213597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07b860-7a82-464e-a0c5-88e34dd0f7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.214515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07b860-7a82-464e-a0c5-88e34dd0f7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.215000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07b860-7a82-464e-a0c5-88e34dd0f7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.215468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07b860-7a82-464e-a0c5-88e34dd0f7c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.216398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07b860-7a82-464e-a0c5-88e34dd0f7c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:34.216900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07b860-7a82-464e-a0c5-88e34dd0f7c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.219390 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07b860-7a82-464e-a0c5-88e34dd0f7c7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.232218 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 530/1038] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:34.239230 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fcdd9-cb06-4d87-9797-f00e50716a65 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.248823 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fcdd9-cb06-4d87-9797-f00e50716a65 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.253746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a9563-0c08-4e67-8098-a4c56110ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.254555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a9563-0c08-4e67-8098-a4c56110ca42 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.254836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a9563-0c08-4e67-8098-a4c56110ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.255105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a9563-0c08-4e67-8098-a4c56110ca42 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.262736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a9563-0c08-4e67-8098-a4c56110ca42 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.264789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a9563-0c08-4e67-8098-a4c56110ca42 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.283813 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-cd7a9563-0c08-4e67-8098-a4c56110ca42 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 09 00:57:34.290079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 509/1039] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:34.291394 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07b860-7a82-464e-a0c5-88e34dd0f7c7 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.301948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07b860-7a82-464e-a0c5-88e34dd0f7c7 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.306691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc0765-7af6-4d85-bc33-ee8646bf768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.307425 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc0765-7af6-4d85-bc33-ee8646bf768e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.307781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc0765-7af6-4d85-bc33-ee8646bf768e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.308129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc0765-7af6-4d85-bc33-ee8646bf768e admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.309044 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc0765-7af6-4d85-bc33-ee8646bf768e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:34.309426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc0765-7af6-4d85-bc33-ee8646bf768e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.311379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc0765-7af6-4d85-bc33-ee8646bf768e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.334785 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 531/1040] 10.222.0.23 () {56 vars in 1154 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:34.335588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a9563-0c08-4e67-8098-a4c56110ca42 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.346795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a9563-0c08-4e67-8098-a4c56110ca42 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.351700 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923ba4-74fa-41cb-b693-cdaba695abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.352369 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923ba4-74fa-41cb-b693-cdaba695abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.352652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923ba4-74fa-41cb-b693-cdaba695abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.352928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923ba4-74fa-41cb-b693-cdaba695abc1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.362259 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d923ba4-74fa-41cb-b693-cdaba695abc1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.364056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d923ba4-74fa-41cb-b693-cdaba695abc1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.374243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 510/1041] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 00:57:34.381612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc0765-7af6-4d85-bc33-ee8646bf768e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.392413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc0765-7af6-4d85-bc33-ee8646bf768e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.397009 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda17c4-5bef-411b-b2e6-59b6262a62c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.397786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda17c4-5bef-411b-b2e6-59b6262a62c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.398069 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda17c4-5bef-411b-b2e6-59b6262a62c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.398344 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda17c4-5bef-411b-b2e6-59b6262a62c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.409739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda17c4-5bef-411b-b2e6-59b6262a62c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.411583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda17c4-5bef-411b-b2e6-59b6262a62c6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.428457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-5bda17c4-5bef-411b-b2e6-59b6262a62c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:34.429780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 532/1042] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:34.436025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923ba4-74fa-41cb-b693-cdaba695abc1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.445483 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923ba4-74fa-41cb-b693-cdaba695abc1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.450193 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2f92a-e635-45bd-92c2-a46b74039a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.450951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2f92a-e635-45bd-92c2-a46b74039a85 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.451300 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2f92a-e635-45bd-92c2-a46b74039a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.451642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2f92a-e635-45bd-92c2-a46b74039a85 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.452438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2f92a-e635-45bd-92c2-a46b74039a85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:34.453429 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2f92a-e635-45bd-92c2-a46b74039a85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.455413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2f92a-e635-45bd-92c2-a46b74039a85 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.470719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 511/1043] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:34.474105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda17c4-5bef-411b-b2e6-59b6262a62c6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.484087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda17c4-5bef-411b-b2e6-59b6262a62c6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.488663 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130e848-e156-4ecb-b872-f73019a681f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.489430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130e848-e156-4ecb-b872-f73019a681f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.489707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130e848-e156-4ecb-b872-f73019a681f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.489978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130e848-e156-4ecb-b872-f73019a681f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.496921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130e848-e156-4ecb-b872-f73019a681f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.498889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130e848-e156-4ecb-b872-f73019a681f3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.511832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-d130e848-e156-4ecb-b872-f73019a681f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:34.514743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 533/1044] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:34.519916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2f92a-e635-45bd-92c2-a46b74039a85 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.530255 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2f92a-e635-45bd-92c2-a46b74039a85 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.535610 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad5485-c59c-4c7e-8149-ce8bc8afa72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.536349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad5485-c59c-4c7e-8149-ce8bc8afa72d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.536719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad5485-c59c-4c7e-8149-ce8bc8afa72d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.537060 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad5485-c59c-4c7e-8149-ce8bc8afa72d admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.537927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad5485-c59c-4c7e-8149-ce8bc8afa72d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:34.538308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad5485-c59c-4c7e-8149-ce8bc8afa72d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.540261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad5485-c59c-4c7e-8149-ce8bc8afa72d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.553542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 512/1045] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:34.560141 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130e848-e156-4ecb-b872-f73019a681f3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.570983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130e848-e156-4ecb-b872-f73019a681f3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.575390 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9c546-654e-40d3-8925-090f2102ebf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.576009 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9c546-654e-40d3-8925-090f2102ebf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.576285 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9c546-654e-40d3-8925-090f2102ebf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.576555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9c546-654e-40d3-8925-090f2102ebf8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.577376 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9c546-654e-40d3-8925-090f2102ebf8 admin admin] RBAC: Adding query filter params (role.id=a0c4d698c22c4b8e8a5d633ba758a5bb, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=53d32ba063bc4a719d4c2f67d88ec640) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:34.577722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9c546-654e-40d3-8925-090f2102ebf8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.579575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9c546-654e-40d3-8925-090f2102ebf8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.590732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 534/1046] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/role_assignments?user.id=53d32ba063bc4a719d4c2f67d88ec640&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=a0c4d698c22c4b8e8a5d633ba758a5bb => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:34.770830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd557d-c19e-4be7-ad37-b43d86ff23c6 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.771199 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd557d-c19e-4be7-ad37-b43d86ff23c6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.771396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd557d-c19e-4be7-ad37-b43d86ff23c6 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.773316 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 513/1047] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:34.779361 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1b328-b4d7-4931-a484-ca083b13f2d8 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.779648 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1b328-b4d7-4931-a484-ca083b13f2d8 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.779926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1b328-b4d7-4931-a484-ca083b13f2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.798889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e2c1b328-b4d7-4931-a484-ca083b13f2d8 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:34.800094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e2c1b328-b4d7-4931-a484-ca083b13f2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:34.808456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 535/1048] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:34.831802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd557d-c19e-4be7-ad37-b43d86ff23c6 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.847534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd557d-c19e-4be7-ad37-b43d86ff23c6 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.852565 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fed622-b7f1-4722-a55d-8754155fb8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.853203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fed622-b7f1-4722-a55d-8754155fb8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.853483 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fed622-b7f1-4722-a55d-8754155fb8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.853757 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fed622-b7f1-4722-a55d-8754155fb8c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.862897 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fed622-b7f1-4722-a55d-8754155fb8c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.864627 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fed622-b7f1-4722-a55d-8754155fb8c3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.873580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 514/1049] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:57:34.879928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1b328-b4d7-4931-a484-ca083b13f2d8 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:34.888874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1b328-b4d7-4931-a484-ca083b13f2d8 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:34.893513 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b15c0b-43fe-42a7-bdf9-9aa660335732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:34.894284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b15c0b-43fe-42a7-bdf9-9aa660335732 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:34.894600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b15c0b-43fe-42a7-bdf9-9aa660335732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:34.894877 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b15c0b-43fe-42a7-bdf9-9aa660335732 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:34.896054 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b15c0b-43fe-42a7-bdf9-9aa660335732 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:34.897818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b15c0b-43fe-42a7-bdf9-9aa660335732 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:34.899547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 536/1050] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:35.743814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbef0de-8fd0-415f-abfd-4ce3f449edbb None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:35.744341 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbef0de-8fd0-415f-abfd-4ce3f449edbb None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:35.744432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbef0de-8fd0-415f-abfd-4ce3f449edbb None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:35.746115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 515/1051] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:35.752688 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be762d2f-4b9f-4d07-a91d-0c72b8ee0c85 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:35.753096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be762d2f-4b9f-4d07-a91d-0c72b8ee0c85 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:35.753234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be762d2f-4b9f-4d07-a91d-0c72b8ee0c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:35.771333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-be762d2f-4b9f-4d07-a91d-0c72b8ee0c85 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:35.772505 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-be762d2f-4b9f-4d07-a91d-0c72b8ee0c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:35.780291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 537/1052] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:35.805822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbef0de-8fd0-415f-abfd-4ce3f449edbb None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:35.818665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbef0de-8fd0-415f-abfd-4ce3f449edbb None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:35.822964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc9503-029c-4f8d-a052-3e004d17808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:35.823733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc9503-029c-4f8d-a052-3e004d17808f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:35.824015 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc9503-029c-4f8d-a052-3e004d17808f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:35.824291 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc9503-029c-4f8d-a052-3e004d17808f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:35.825463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc9503-029c-4f8d-a052-3e004d17808f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:35.827175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc9503-029c-4f8d-a052-3e004d17808f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:35.828756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 516/1053] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:35.834814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be762d2f-4b9f-4d07-a91d-0c72b8ee0c85 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:35.843937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be762d2f-4b9f-4d07-a91d-0c72b8ee0c85 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:35.850888 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc3701-5d37-4756-814b-399d065e18b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:35.851551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc3701-5d37-4756-814b-399d065e18b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:35.851834 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc3701-5d37-4756-814b-399d065e18b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:35.852108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc3701-5d37-4756-814b-399d065e18b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:35.852828 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc3701-5d37-4756-814b-399d065e18b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:35.854767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc3701-5d37-4756-814b-399d065e18b2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:35.876051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 538/1054] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:57:35 2021] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:36.926581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28634d9d-2e4f-4e43-8d80-691f0cb93348 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:36.927095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28634d9d-2e4f-4e43-8d80-691f0cb93348 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:36.927187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28634d9d-2e4f-4e43-8d80-691f0cb93348 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:36.928871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 517/1055] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:36.934662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b0083-d8c0-4a85-af6b-c8b2fcf6c9d4 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:36.935073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b0083-d8c0-4a85-af6b-c8b2fcf6c9d4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:36.935217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b0083-d8c0-4a85-af6b-c8b2fcf6c9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:36.953905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9d4b0083-d8c0-4a85-af6b-c8b2fcf6c9d4 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:36.955103 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9d4b0083-d8c0-4a85-af6b-c8b2fcf6c9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:36.962731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 539/1056] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:57:36.986762 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28634d9d-2e4f-4e43-8d80-691f0cb93348 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:36.998685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28634d9d-2e4f-4e43-8d80-691f0cb93348 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:37.003656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb28951-e97c-4512-9018-ceb857e6dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:37.004447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb28951-e97c-4512-9018-ceb857e6dfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:37.004722 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb28951-e97c-4512-9018-ceb857e6dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:37.004990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb28951-e97c-4512-9018-ceb857e6dfd7 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:37.016992 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb28951-e97c-4512-9018-ceb857e6dfd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:37.024792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-ccb28951-e97c-4512-9018-ceb857e6dfd7 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 09 00:57:37.025996 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 518/1057] 10.222.0.23 () {56 vars in 1141 bytes} [Thu Dec 9 00:57:36 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:37.032878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b0083-d8c0-4a85-af6b-c8b2fcf6c9d4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:37.041855 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b0083-d8c0-4a85-af6b-c8b2fcf6c9d4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:37.046378 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c3b54-1fde-4a2e-9c37-b5742bf4556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:37.047426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c3b54-1fde-4a2e-9c37-b5742bf4556e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:37.047710 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c3b54-1fde-4a2e-9c37-b5742bf4556e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:37.047987 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c3b54-1fde-4a2e-9c37-b5742bf4556e admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:37.048768 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c3b54-1fde-4a2e-9c37-b5742bf4556e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:37.049079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c3b54-1fde-4a2e-9c37-b5742bf4556e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:37.050751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c3b54-1fde-4a2e-9c37-b5742bf4556e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:37.060048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 540/1058] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Dec 9 00:57:37 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:37.067122 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb28951-e97c-4512-9018-ceb857e6dfd7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:37.077419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb28951-e97c-4512-9018-ceb857e6dfd7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:37.082691 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960810e-020f-4dca-9282-d2c855ce512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:37.083453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960810e-020f-4dca-9282-d2c855ce512d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:37.083736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960810e-020f-4dca-9282-d2c855ce512d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:37.084011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960810e-020f-4dca-9282-d2c855ce512d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:37.094011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960810e-020f-4dca-9282-d2c855ce512d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:37.095852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960810e-020f-4dca-9282-d2c855ce512d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:37.112474 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-3960810e-020f-4dca-9282-d2c855ce512d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:37.113548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 519/1059] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:37.119727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c3b54-1fde-4a2e-9c37-b5742bf4556e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:37.130245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c3b54-1fde-4a2e-9c37-b5742bf4556e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:37.134752 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3544bf-e0ed-4bd1-8a1b-8bfa726ec233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:37.135396 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3544bf-e0ed-4bd1-8a1b-8bfa726ec233 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:37.135682 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3544bf-e0ed-4bd1-8a1b-8bfa726ec233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:37.135960 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3544bf-e0ed-4bd1-8a1b-8bfa726ec233 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:37.136690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3544bf-e0ed-4bd1-8a1b-8bfa726ec233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:37.136999 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3544bf-e0ed-4bd1-8a1b-8bfa726ec233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:37.138622 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3544bf-e0ed-4bd1-8a1b-8bfa726ec233 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:37.150795 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 541/1060] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:37.157009 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960810e-020f-4dca-9282-d2c855ce512d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:37.166486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960810e-020f-4dca-9282-d2c855ce512d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:37.170841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dd21e-19eb-4132-ad04-9776072fbff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:37.171639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dd21e-19eb-4132-ad04-9776072fbff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:37.171921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dd21e-19eb-4132-ad04-9776072fbff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:37.172186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dd21e-19eb-4132-ad04-9776072fbff5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:37.179186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dd21e-19eb-4132-ad04-9776072fbff5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:37.181199 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dd21e-19eb-4132-ad04-9776072fbff5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:37.195827 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-099dd21e-19eb-4132-ad04-9776072fbff5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 09 00:57:37.196990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 520/1061] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Dec 9 00:57:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:37.204634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3544bf-e0ed-4bd1-8a1b-8bfa726ec233 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:37.214436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3544bf-e0ed-4bd1-8a1b-8bfa726ec233 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:37.219168 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbf36d-60ba-4dff-b275-7b55d03b1476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:37.219816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbf36d-60ba-4dff-b275-7b55d03b1476 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:37.220099 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbf36d-60ba-4dff-b275-7b55d03b1476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:37.220375 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbf36d-60ba-4dff-b275-7b55d03b1476 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:37.221216 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbf36d-60ba-4dff-b275-7b55d03b1476 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:37.221527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbf36d-60ba-4dff-b275-7b55d03b1476 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:37.223405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbf36d-60ba-4dff-b275-7b55d03b1476 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:37.240592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 542/1062] 10.222.0.23 () {56 vars in 1154 bytes} [Thu Dec 9 00:57:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:37.246665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dd21e-19eb-4132-ad04-9776072fbff5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:37.256753 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dd21e-19eb-4132-ad04-9776072fbff5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:37.261126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d153e9c-27f8-47ae-b1d7-a7c133d17dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:37.261893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d153e9c-27f8-47ae-b1d7-a7c133d17dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:37.262170 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d153e9c-27f8-47ae-b1d7-a7c133d17dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:37.262477 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d153e9c-27f8-47ae-b1d7-a7c133d17dd0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:37.272811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d153e9c-27f8-47ae-b1d7-a7c133d17dd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:37.274653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d153e9c-27f8-47ae-b1d7-a7c133d17dd0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:37.291663 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-5d153e9c-27f8-47ae-b1d7-a7c133d17dd0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:37.292798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 521/1063] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:37.299454 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbf36d-60ba-4dff-b275-7b55d03b1476 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:37.309068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbf36d-60ba-4dff-b275-7b55d03b1476 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:37.313716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd0b41-3a87-4d4b-b4ae-578b4822dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:37.314358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd0b41-3a87-4d4b-b4ae-578b4822dc3d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:37.314667 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd0b41-3a87-4d4b-b4ae-578b4822dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:37.314944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd0b41-3a87-4d4b-b4ae-578b4822dc3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:37.315676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd0b41-3a87-4d4b-b4ae-578b4822dc3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:37.315984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd0b41-3a87-4d4b-b4ae-578b4822dc3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:37.317583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd0b41-3a87-4d4b-b4ae-578b4822dc3d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:37.329156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 543/1064] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:37.334936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d153e9c-27f8-47ae-b1d7-a7c133d17dd0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:37.345043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d153e9c-27f8-47ae-b1d7-a7c133d17dd0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:37.349484 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff5c54-5078-47ae-8cc4-5add304a5e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:37.350275 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff5c54-5078-47ae-8cc4-5add304a5e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:37.350586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff5c54-5078-47ae-8cc4-5add304a5e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:37.350859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff5c54-5078-47ae-8cc4-5add304a5e89 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:37.357505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff5c54-5078-47ae-8cc4-5add304a5e89 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:37.359694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff5c54-5078-47ae-8cc4-5add304a5e89 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:37.372462 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-c9ff5c54-5078-47ae-8cc4-5add304a5e89 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:37.373527 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 522/1065] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:37.379797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd0b41-3a87-4d4b-b4ae-578b4822dc3d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:37.389269 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd0b41-3a87-4d4b-b4ae-578b4822dc3d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:37.394358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb99cd2-3969-4039-894d-a5c1ee3c381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:37.395022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb99cd2-3969-4039-894d-a5c1ee3c381c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:37.395306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb99cd2-3969-4039-894d-a5c1ee3c381c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:37.395586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb99cd2-3969-4039-894d-a5c1ee3c381c admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:37.396422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb99cd2-3969-4039-894d-a5c1ee3c381c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:37.396739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb99cd2-3969-4039-894d-a5c1ee3c381c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:37.398609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb99cd2-3969-4039-894d-a5c1ee3c381c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:37.411872 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 544/1066] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:37.418229 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff5c54-5078-47ae-8cc4-5add304a5e89 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:37.429247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff5c54-5078-47ae-8cc4-5add304a5e89 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:37.433647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fee40-8c02-4a89-98d5-bcfc12d9f5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:37.434527 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fee40-8c02-4a89-98d5-bcfc12d9f5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:37.434811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fee40-8c02-4a89-98d5-bcfc12d9f5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:37.435083 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fee40-8c02-4a89-98d5-bcfc12d9f5cd admin admin] PATH_INFO: `/v3/projects/0566d367619740a48d8dca2def78a386/users/53d32ba063bc4a719d4c2f67d88ec640/roles/a0c4d698c22c4b8e8a5d633ba758a5bb` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:37.437514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fee40-8c02-4a89-98d5-bcfc12d9f5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566d367619740a48d8dca2def78a386, user_id=53d32ba063bc4a719d4c2f67d88ec640, role_id=a0c4d698c22c4b8e8a5d633ba758a5bb)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:37.440136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fee40-8c02-4a89-98d5-bcfc12d9f5cd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:37.453857 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 523/1067] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:57:37 2021] PUT /identity/v3/projects/0566d367619740a48d8dca2def78a386/users/53d32ba063bc4a719d4c2f67d88ec640/roles/a0c4d698c22c4b8e8a5d633ba758a5bb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:57:38.257888 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd2611-8a4b-422e-b396-28425599d9ca None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:38.258426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd2611-8a4b-422e-b396-28425599d9ca None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:38.258426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd2611-8a4b-422e-b396-28425599d9ca None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:38.260142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 545/1068] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:38.266057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66429f08-de46-496c-af90-d82ff6ac1a71 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:38.266500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66429f08-de46-496c-af90-d82ff6ac1a71 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:38.266754 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66429f08-de46-496c-af90-d82ff6ac1a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:38.283445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-66429f08-de46-496c-af90-d82ff6ac1a71 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:38.284615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-66429f08-de46-496c-af90-d82ff6ac1a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:38.339635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 524/1069] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:38.364107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd2611-8a4b-422e-b396-28425599d9ca None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:38.376707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd2611-8a4b-422e-b396-28425599d9ca None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:38.381029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5c93c-5bbd-469b-bf9e-96b0d4e84280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:38.381799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5c93c-5bbd-469b-bf9e-96b0d4e84280 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:38.382084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5c93c-5bbd-469b-bf9e-96b0d4e84280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:38.382359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5c93c-5bbd-469b-bf9e-96b0d4e84280 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:38.393609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5c93c-5bbd-469b-bf9e-96b0d4e84280 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:38.401705 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-ddd5c93c-5bbd-469b-bf9e-96b0d4e84280 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:57:38.402930 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 546/1070] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:38.410067 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66429f08-de46-496c-af90-d82ff6ac1a71 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:38.419053 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66429f08-de46-496c-af90-d82ff6ac1a71 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:38.424221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8b598-157e-4225-abaf-aa6a8b9e5a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:38.424866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8b598-157e-4225-abaf-aa6a8b9e5a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:38.425148 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8b598-157e-4225-abaf-aa6a8b9e5a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:38.425425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8b598-157e-4225-abaf-aa6a8b9e5a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:38.426177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8b598-157e-4225-abaf-aa6a8b9e5a5b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:38.426513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8b598-157e-4225-abaf-aa6a8b9e5a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:38.428091 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8b598-157e-4225-abaf-aa6a8b9e5a5b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:38.436068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 525/1071] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:57:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:38.443229 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5c93c-5bbd-469b-bf9e-96b0d4e84280 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:38.452933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5c93c-5bbd-469b-bf9e-96b0d4e84280 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:38.457469 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f3cd5-06ae-4054-a617-6cffb234f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:38.458319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f3cd5-06ae-4054-a617-6cffb234f5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:38.458642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f3cd5-06ae-4054-a617-6cffb234f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:38.458920 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f3cd5-06ae-4054-a617-6cffb234f5f8 admin admin] PATH_INFO: `/v3/users/e2c6c951a29147cba0c6cc55b4b783fd` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:38.472813 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f3cd5-06ae-4054-a617-6cffb234f5f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=e2c6c951a29147cba0c6cc55b4b783fd)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:38.474956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f3cd5-06ae-4054-a617-6cffb234f5f8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:38.476747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 547/1072] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:57:38 2021] GET /identity/v3/users/e2c6c951a29147cba0c6cc55b4b783fd => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:38.482722 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8b598-157e-4225-abaf-aa6a8b9e5a5b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:38.493024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8b598-157e-4225-abaf-aa6a8b9e5a5b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:38.497490 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf484ee9-8df7-4b17-ae90-4f4ea986bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:38.498118 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484ee9-8df7-4b17-ae90-4f4ea986bd5c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:38.498417 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484ee9-8df7-4b17-ae90-4f4ea986bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:38.498694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484ee9-8df7-4b17-ae90-4f4ea986bd5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:38.506458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf484ee9-8df7-4b17-ae90-4f4ea986bd5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:38.508226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf484ee9-8df7-4b17-ae90-4f4ea986bd5c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:38.516817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 526/1073] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:38 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:57:38.523214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f3cd5-06ae-4054-a617-6cffb234f5f8 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:38.533392 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f3cd5-06ae-4054-a617-6cffb234f5f8 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:38.537894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6345e-f8d7-45d4-a02a-2847cfbbb280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:38.538769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6345e-f8d7-45d4-a02a-2847cfbbb280 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:38.539055 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6345e-f8d7-45d4-a02a-2847cfbbb280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:38.539332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6345e-f8d7-45d4-a02a-2847cfbbb280 admin admin] PATH_INFO: `/v3/projects/b2de1de0373446d4801b7411abd7aeeb` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:38.540523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6345e-f8d7-45d4-a02a-2847cfbbb280 admin admin] RBAC: Authorizing `identity:get_project(project_id=b2de1de0373446d4801b7411abd7aeeb)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:38.542573 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6345e-f8d7-45d4-a02a-2847cfbbb280 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:38.544243 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 548/1074] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:57:38 2021] GET /identity/v3/projects/b2de1de0373446d4801b7411abd7aeeb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:38.551243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf484ee9-8df7-4b17-ae90-4f4ea986bd5c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:38.560030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf484ee9-8df7-4b17-ae90-4f4ea986bd5c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:38.565232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f1edd-27d8-48bc-b75a-75d21ca2a712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:38.565861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f1edd-27d8-48bc-b75a-75d21ca2a712 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:38.566140 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f1edd-27d8-48bc-b75a-75d21ca2a712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:38.566434 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f1edd-27d8-48bc-b75a-75d21ca2a712 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:38.567289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f1edd-27d8-48bc-b75a-75d21ca2a712 admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=b2de1de0373446d4801b7411abd7aeeb, user.id=e2c6c951a29147cba0c6cc55b4b783fd) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:38.567594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f1edd-27d8-48bc-b75a-75d21ca2a712 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:38.569405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f1edd-27d8-48bc-b75a-75d21ca2a712 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:38.574939 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 527/1075] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:38 2021] GET /identity/v3/role_assignments?user.id=e2c6c951a29147cba0c6cc55b4b783fd&scope.project.id=b2de1de0373446d4801b7411abd7aeeb&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:39.868210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38630997-6abc-4a9e-99af-7a3a12add7d5 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:39.868684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38630997-6abc-4a9e-99af-7a3a12add7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:39.868800 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38630997-6abc-4a9e-99af-7a3a12add7d5 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:39.870527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 549/1076] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:39.876436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c5312-8f88-4ca6-8a06-4e04bdfe08e1 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:39.876851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c5312-8f88-4ca6-8a06-4e04bdfe08e1 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:39.877105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c5312-8f88-4ca6-8a06-4e04bdfe08e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:39.895094 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-442c5312-8f88-4ca6-8a06-4e04bdfe08e1 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:39.896263 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-442c5312-8f88-4ca6-8a06-4e04bdfe08e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:39.903748 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 528/1077] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:39.928190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38630997-6abc-4a9e-99af-7a3a12add7d5 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:39.940524 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38630997-6abc-4a9e-99af-7a3a12add7d5 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:39.944814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4015ad-63c9-41fc-8c37-f490ab9f241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:39.945588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4015ad-63c9-41fc-8c37-f490ab9f241d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:39.945867 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4015ad-63c9-41fc-8c37-f490ab9f241d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:39.946136 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4015ad-63c9-41fc-8c37-f490ab9f241d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:39.956536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4015ad-63c9-41fc-8c37-f490ab9f241d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:39.963764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-8f4015ad-63c9-41fc-8c37-f490ab9f241d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 09 00:57:39.964902 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 550/1078] 10.222.0.23 () {56 vars in 1141 bytes} [Thu Dec 9 00:57:39 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:39.971625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c5312-8f88-4ca6-8a06-4e04bdfe08e1 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:39.980339 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c5312-8f88-4ca6-8a06-4e04bdfe08e1 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:39.984840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa0dba-51a0-4507-9e28-cc7d26c1233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:39.985492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa0dba-51a0-4507-9e28-cc7d26c1233d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:39.985770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa0dba-51a0-4507-9e28-cc7d26c1233d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:39.986303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa0dba-51a0-4507-9e28-cc7d26c1233d admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:39.987074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa0dba-51a0-4507-9e28-cc7d26c1233d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:39.987375 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa0dba-51a0-4507-9e28-cc7d26c1233d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:39.988937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa0dba-51a0-4507-9e28-cc7d26c1233d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:39.996735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 529/1079] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Dec 9 00:57:39 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:40.003324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4015ad-63c9-41fc-8c37-f490ab9f241d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:40.012632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4015ad-63c9-41fc-8c37-f490ab9f241d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:40.017634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbdad5-d251-4f48-9be6-fb89e0859c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:40.018405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbdad5-d251-4f48-9be6-fb89e0859c7e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:40.018685 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbdad5-d251-4f48-9be6-fb89e0859c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:40.018956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbdad5-d251-4f48-9be6-fb89e0859c7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:40.029187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbdad5-d251-4f48-9be6-fb89e0859c7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:40.031006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbdad5-d251-4f48-9be6-fb89e0859c7e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:40.046596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-f0bbdad5-d251-4f48-9be6-fb89e0859c7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:40.047711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 551/1080] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:40.053644 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa0dba-51a0-4507-9e28-cc7d26c1233d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:40.063670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa0dba-51a0-4507-9e28-cc7d26c1233d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:40.068043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc338d31-d486-4c48-bff8-a28a21c1fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:40.068670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc338d31-d486-4c48-bff8-a28a21c1fedf admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:40.068947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc338d31-d486-4c48-bff8-a28a21c1fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:40.069218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc338d31-d486-4c48-bff8-a28a21c1fedf admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:40.069931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc338d31-d486-4c48-bff8-a28a21c1fedf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:40.070230 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc338d31-d486-4c48-bff8-a28a21c1fedf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:40.071898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc338d31-d486-4c48-bff8-a28a21c1fedf admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:40.083257 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 530/1081] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:40.089025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbdad5-d251-4f48-9be6-fb89e0859c7e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:40.099254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbdad5-d251-4f48-9be6-fb89e0859c7e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:40.103712 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792f2bf-b622-4a9b-9933-d6f962f82874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:40.104469 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792f2bf-b622-4a9b-9933-d6f962f82874 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:40.104753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792f2bf-b622-4a9b-9933-d6f962f82874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:40.105031 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792f2bf-b622-4a9b-9933-d6f962f82874 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:40.113540 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792f2bf-b622-4a9b-9933-d6f962f82874 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:40.115546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792f2bf-b622-4a9b-9933-d6f962f82874 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:40.128337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-7792f2bf-b622-4a9b-9933-d6f962f82874 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 09 00:57:40.129572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 552/1082] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Dec 9 00:57:40 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:40.135542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc338d31-d486-4c48-bff8-a28a21c1fedf admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:40.145100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc338d31-d486-4c48-bff8-a28a21c1fedf admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:40.149451 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddca227-d799-4c11-b1b9-1f33710a7405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:40.150108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddca227-d799-4c11-b1b9-1f33710a7405 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:40.150411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddca227-d799-4c11-b1b9-1f33710a7405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:40.150686 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddca227-d799-4c11-b1b9-1f33710a7405 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:40.151508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddca227-d799-4c11-b1b9-1f33710a7405 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:40.151808 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddca227-d799-4c11-b1b9-1f33710a7405 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:40.153627 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddca227-d799-4c11-b1b9-1f33710a7405 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:40.170788 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 531/1083] 10.222.0.23 () {56 vars in 1154 bytes} [Thu Dec 9 00:57:40 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:40.176756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792f2bf-b622-4a9b-9933-d6f962f82874 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:40.186049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792f2bf-b622-4a9b-9933-d6f962f82874 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:40.191003 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cadcf-0bc9-418f-bf3b-93af1e204f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:40.191620 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cadcf-0bc9-418f-bf3b-93af1e204f5b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:40.191899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cadcf-0bc9-418f-bf3b-93af1e204f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:40.192172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cadcf-0bc9-418f-bf3b-93af1e204f5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:40.199675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cadcf-0bc9-418f-bf3b-93af1e204f5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:40.201388 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cadcf-0bc9-418f-bf3b-93af1e204f5b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:40.210496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 553/1084] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:40 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:57:40.216586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddca227-d799-4c11-b1b9-1f33710a7405 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:40.225912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddca227-d799-4c11-b1b9-1f33710a7405 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:40.230296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba788d7-9fcd-4906-82b9-e044a28f46c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:40.231089 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba788d7-9fcd-4906-82b9-e044a28f46c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:40.231364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba788d7-9fcd-4906-82b9-e044a28f46c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:40.231631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba788d7-9fcd-4906-82b9-e044a28f46c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:40.242061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba788d7-9fcd-4906-82b9-e044a28f46c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:40.243881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba788d7-9fcd-4906-82b9-e044a28f46c7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:40.260705 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-dba788d7-9fcd-4906-82b9-e044a28f46c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:57:40.261952 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 532/1085] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:57:40.268657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cadcf-0bc9-418f-bf3b-93af1e204f5b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:40.277371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cadcf-0bc9-418f-bf3b-93af1e204f5b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:40.282706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bccb66-bb0a-4312-aca5-3d3605bad3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:40.283349 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bccb66-bb0a-4312-aca5-3d3605bad3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:40.283629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bccb66-bb0a-4312-aca5-3d3605bad3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:40.283907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bccb66-bb0a-4312-aca5-3d3605bad3c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:40.284626 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bccb66-bb0a-4312-aca5-3d3605bad3c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:40.284932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bccb66-bb0a-4312-aca5-3d3605bad3c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:40.286594 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bccb66-bb0a-4312-aca5-3d3605bad3c9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:40.299352 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 554/1086] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:57:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:40.305460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba788d7-9fcd-4906-82b9-e044a28f46c7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:40.314973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba788d7-9fcd-4906-82b9-e044a28f46c7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:40.319364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89c912-f23c-40b5-85c3-3f69f30063f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:40.320125 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89c912-f23c-40b5-85c3-3f69f30063f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:40.320401 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89c912-f23c-40b5-85c3-3f69f30063f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:40.320670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89c912-f23c-40b5-85c3-3f69f30063f7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:40.327335 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89c912-f23c-40b5-85c3-3f69f30063f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:40.329892 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89c912-f23c-40b5-85c3-3f69f30063f7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:40.342402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-2e89c912-f23c-40b5-85c3-3f69f30063f7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:57:40.344141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 533/1087] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:57:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:40.350621 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bccb66-bb0a-4312-aca5-3d3605bad3c9 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:40.360230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bccb66-bb0a-4312-aca5-3d3605bad3c9 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:40.364898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90a8c4-0287-4815-a6fa-42cd91d062f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:40.365529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90a8c4-0287-4815-a6fa-42cd91d062f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:40.365806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90a8c4-0287-4815-a6fa-42cd91d062f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:40.366078 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90a8c4-0287-4815-a6fa-42cd91d062f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:40.366884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90a8c4-0287-4815-a6fa-42cd91d062f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:40.367188 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90a8c4-0287-4815-a6fa-42cd91d062f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:40.369025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90a8c4-0287-4815-a6fa-42cd91d062f8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:40.380267 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 555/1088] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:57:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:40.386566 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89c912-f23c-40b5-85c3-3f69f30063f7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:40.397670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89c912-f23c-40b5-85c3-3f69f30063f7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:40.402051 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a019271-b935-4ae0-b848-53967ac21319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:40.402706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a019271-b935-4ae0-b848-53967ac21319 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:40.402985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a019271-b935-4ae0-b848-53967ac21319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:40.403258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a019271-b935-4ae0-b848-53967ac21319 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:40.404085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a019271-b935-4ae0-b848-53967ac21319 admin admin] RBAC: Adding query filter params (role.id=a0c4d698c22c4b8e8a5d633ba758a5bb, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=53d32ba063bc4a719d4c2f67d88ec640) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:40.404390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a019271-b935-4ae0-b848-53967ac21319 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:40.407158 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a019271-b935-4ae0-b848-53967ac21319 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:40.412904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 534/1089] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:40 2021] GET /identity/v3/role_assignments?user.id=53d32ba063bc4a719d4c2f67d88ec640&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=a0c4d698c22c4b8e8a5d633ba758a5bb => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:40.920950 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c335-76d1-4c97-a2a6-a25693f63af1 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:40.921450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c335-76d1-4c97-a2a6-a25693f63af1 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:40.921528 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c335-76d1-4c97-a2a6-a25693f63af1 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:40.923436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 556/1090] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:40.929531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1715f-b310-4533-a510-91fa866cf47e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:40.929950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1715f-b310-4533-a510-91fa866cf47e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:40.930130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1715f-b310-4533-a510-91fa866cf47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:40.947869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-71d1715f-b310-4533-a510-91fa866cf47e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:40.949050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-71d1715f-b310-4533-a510-91fa866cf47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:40.957515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 535/1091] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:40.981210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c335-76d1-4c97-a2a6-a25693f63af1 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:40.994536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c335-76d1-4c97-a2a6-a25693f63af1 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:40.999009 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f027a-80db-4d46-9539-0e5898756ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:41.000313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f027a-80db-4d46-9539-0e5898756ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:41.000740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f027a-80db-4d46-9539-0e5898756ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:41.001013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f027a-80db-4d46-9539-0e5898756ac3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:41.011465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f027a-80db-4d46-9539-0e5898756ac3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:41.019235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-725f027a-80db-4d46-9539-0e5898756ac3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:57:41.020423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 557/1092] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:41.027163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1715f-b310-4533-a510-91fa866cf47e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:41.036369 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1715f-b310-4533-a510-91fa866cf47e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:41.042025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51789848-2388-4189-b35b-e89ad2b3f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:41.042769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51789848-2388-4189-b35b-e89ad2b3f6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:41.043055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51789848-2388-4189-b35b-e89ad2b3f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:41.043338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51789848-2388-4189-b35b-e89ad2b3f6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:41.044097 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51789848-2388-4189-b35b-e89ad2b3f6aa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:41.044399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51789848-2388-4189-b35b-e89ad2b3f6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:41.045982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51789848-2388-4189-b35b-e89ad2b3f6aa admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:41.055129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 536/1093] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:57:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:41.061687 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f027a-80db-4d46-9539-0e5898756ac3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:41.072141 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f027a-80db-4d46-9539-0e5898756ac3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:41.076667 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f49c4e-db42-4265-9910-6f7961720bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:41.078056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f49c4e-db42-4265-9910-6f7961720bad admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:41.078336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f49c4e-db42-4265-9910-6f7961720bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:41.078657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f49c4e-db42-4265-9910-6f7961720bad admin admin] PATH_INFO: `/v3/users/e2c6c951a29147cba0c6cc55b4b783fd` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:41.079878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f49c4e-db42-4265-9910-6f7961720bad admin admin] RBAC: Authorizing `identity:get_user(user_id=e2c6c951a29147cba0c6cc55b4b783fd)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:41.081983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f49c4e-db42-4265-9910-6f7961720bad admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:41.083616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 558/1094] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:57:41 2021] GET /identity/v3/users/e2c6c951a29147cba0c6cc55b4b783fd => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:41.089906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51789848-2388-4189-b35b-e89ad2b3f6aa admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:41.100534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51789848-2388-4189-b35b-e89ad2b3f6aa admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:41.104990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c6caf-5971-462b-a15f-4065ecbc8e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:41.105834 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c6caf-5971-462b-a15f-4065ecbc8e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:41.106115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c6caf-5971-462b-a15f-4065ecbc8e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:41.106414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c6caf-5971-462b-a15f-4065ecbc8e2c admin admin] PATH_INFO: `/v3/projects/b2de1de0373446d4801b7411abd7aeeb` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:41.107595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c6caf-5971-462b-a15f-4065ecbc8e2c admin admin] RBAC: Authorizing `identity:get_project(project_id=b2de1de0373446d4801b7411abd7aeeb)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:41.110402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c6caf-5971-462b-a15f-4065ecbc8e2c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:41.112314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 537/1095] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:57:41 2021] GET /identity/v3/projects/b2de1de0373446d4801b7411abd7aeeb => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:41.118708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f49c4e-db42-4265-9910-6f7961720bad admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:41.129210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f49c4e-db42-4265-9910-6f7961720bad admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:41.133759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2329bed-04db-4ace-97e7-3bc23f52b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:41.134660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2329bed-04db-4ace-97e7-3bc23f52b243 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:41.134941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2329bed-04db-4ace-97e7-3bc23f52b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:41.135215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2329bed-04db-4ace-97e7-3bc23f52b243 admin admin] PATH_INFO: `/v3/projects/b2de1de0373446d4801b7411abd7aeeb/users/e2c6c951a29147cba0c6cc55b4b783fd/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:41.137181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2329bed-04db-4ace-97e7-3bc23f52b243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2de1de0373446d4801b7411abd7aeeb, user_id=e2c6c951a29147cba0c6cc55b4b783fd, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:41.139851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2329bed-04db-4ace-97e7-3bc23f52b243 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:41.153896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 559/1096] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:57:41 2021] PUT /identity/v3/projects/b2de1de0373446d4801b7411abd7aeeb/users/e2c6c951a29147cba0c6cc55b4b783fd/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:57:43.530249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c54f5-1d7b-497c-8eb7-4a04837cf65e None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:43.530878 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c54f5-1d7b-497c-8eb7-4a04837cf65e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:43.531442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c54f5-1d7b-497c-8eb7-4a04837cf65e None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:43.533206 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 538/1097] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:43.538942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fcaca-5009-4705-80ac-e9787d0d87a9 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:43.539332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fcaca-5009-4705-80ac-e9787d0d87a9 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:43.539493 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fcaca-5009-4705-80ac-e9787d0d87a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:43.557465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ba6fcaca-5009-4705-80ac-e9787d0d87a9 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:43.558664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ba6fcaca-5009-4705-80ac-e9787d0d87a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:43.615105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 560/1098] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:43.640319 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c54f5-1d7b-497c-8eb7-4a04837cf65e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:43.652177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c54f5-1d7b-497c-8eb7-4a04837cf65e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:43.657058 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8af8bd-31b0-4060-a3e6-626c10ef7632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:43.657818 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8af8bd-31b0-4060-a3e6-626c10ef7632 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:43.658102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8af8bd-31b0-4060-a3e6-626c10ef7632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:43.658413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8af8bd-31b0-4060-a3e6-626c10ef7632 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:43.668759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8af8bd-31b0-4060-a3e6-626c10ef7632 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:57:43.676160 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-7f8af8bd-31b0-4060-a3e6-626c10ef7632 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:57:43.677278 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 539/1099] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:57:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:57:43.683406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fcaca-5009-4705-80ac-e9787d0d87a9 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:43.692060 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fcaca-5009-4705-80ac-e9787d0d87a9 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:43.696583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b2fbe-c23a-45f0-97d2-3aac79257912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:43.697225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b2fbe-c23a-45f0-97d2-3aac79257912 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:43.697509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b2fbe-c23a-45f0-97d2-3aac79257912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:43.697783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b2fbe-c23a-45f0-97d2-3aac79257912 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:43.698577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b2fbe-c23a-45f0-97d2-3aac79257912 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:43.698887 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b2fbe-c23a-45f0-97d2-3aac79257912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:43.700472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b2fbe-c23a-45f0-97d2-3aac79257912 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:43.708375 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 561/1100] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:57:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:57:43.714520 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8af8bd-31b0-4060-a3e6-626c10ef7632 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:43.724329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8af8bd-31b0-4060-a3e6-626c10ef7632 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:43.728798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fb746-664c-4771-9b67-8b5c63d60ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:43.729621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fb746-664c-4771-9b67-8b5c63d60ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:43.729906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fb746-664c-4771-9b67-8b5c63d60ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:43.730182 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fb746-664c-4771-9b67-8b5c63d60ec5 admin admin] PATH_INFO: `/v3/users/e2c6c951a29147cba0c6cc55b4b783fd` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:43.731408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fb746-664c-4771-9b67-8b5c63d60ec5 admin admin] RBAC: Authorizing `identity:get_user(user_id=e2c6c951a29147cba0c6cc55b4b783fd)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:43.733555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fb746-664c-4771-9b67-8b5c63d60ec5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:43.735972 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 540/1101] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:57:43 2021] GET /identity/v3/users/e2c6c951a29147cba0c6cc55b4b783fd => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:43.741678 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b2fbe-c23a-45f0-97d2-3aac79257912 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:43.751255 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b2fbe-c23a-45f0-97d2-3aac79257912 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:43.755776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb1a19-daff-4a8f-b7a8-e3bdbe877d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:43.756382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb1a19-daff-4a8f-b7a8-e3bdbe877d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:43.756665 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb1a19-daff-4a8f-b7a8-e3bdbe877d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:43.756940 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb1a19-daff-4a8f-b7a8-e3bdbe877d77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:43.764363 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb1a19-daff-4a8f-b7a8-e3bdbe877d77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:43.766499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb1a19-daff-4a8f-b7a8-e3bdbe877d77 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:43.775010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 562/1102] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:43 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:57:43.781462 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fb746-664c-4771-9b67-8b5c63d60ec5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:43.790621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fb746-664c-4771-9b67-8b5c63d60ec5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:43.795057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94f624-9712-49b0-94b8-658ca03c4e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:43.795848 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94f624-9712-49b0-94b8-658ca03c4e7d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:43.796692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94f624-9712-49b0-94b8-658ca03c4e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:43.797184 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94f624-9712-49b0-94b8-658ca03c4e7d admin admin] PATH_INFO: `/v3/projects/b2de1de0373446d4801b7411abd7aeeb` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:43.798115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94f624-9712-49b0-94b8-658ca03c4e7d admin admin] RBAC: Authorizing `identity:get_project(project_id=b2de1de0373446d4801b7411abd7aeeb)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:43.800128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94f624-9712-49b0-94b8-658ca03c4e7d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:43.801709 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 541/1103] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:57:43 2021] GET /identity/v3/projects/b2de1de0373446d4801b7411abd7aeeb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:43.807621 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb1a19-daff-4a8f-b7a8-e3bdbe877d77 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:43.816156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb1a19-daff-4a8f-b7a8-e3bdbe877d77 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:43.820627 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44799bd8-65fe-4cd0-9d92-b4bd30a7a6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:43.821223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44799bd8-65fe-4cd0-9d92-b4bd30a7a6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:43.821501 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44799bd8-65fe-4cd0-9d92-b4bd30a7a6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:43.821775 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44799bd8-65fe-4cd0-9d92-b4bd30a7a6a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:43.822620 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44799bd8-65fe-4cd0-9d92-b4bd30a7a6a0 admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=b2de1de0373446d4801b7411abd7aeeb, user.id=e2c6c951a29147cba0c6cc55b4b783fd) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:43.822931 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44799bd8-65fe-4cd0-9d92-b4bd30a7a6a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:43.824692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44799bd8-65fe-4cd0-9d92-b4bd30a7a6a0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:43.830405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 563/1104] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:43 2021] GET /identity/v3/role_assignments?user.id=e2c6c951a29147cba0c6cc55b4b783fd&scope.project.id=b2de1de0373446d4801b7411abd7aeeb&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:46.183430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8bcf-55b1-420e-86f9-d8966a545291 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:46.183929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8bcf-55b1-420e-86f9-d8966a545291 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:46.183929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8bcf-55b1-420e-86f9-d8966a545291 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:46.185636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 542/1105] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:46.191460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f9ac0-f32f-4f1c-b157-443f582eb726 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:46.191843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f9ac0-f32f-4f1c-b157-443f582eb726 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:46.192006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f9ac0-f32f-4f1c-b157-443f582eb726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:46.209046 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ae0f9ac0-f32f-4f1c-b157-443f582eb726 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:46.210222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ae0f9ac0-f32f-4f1c-b157-443f582eb726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:46.217622 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 564/1106] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:46 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:46.244266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af8bcf-55b1-420e-86f9-d8966a545291 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:46.256675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af8bcf-55b1-420e-86f9-d8966a545291 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:46.260943 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20307c-a90d-4f63-8b61-8108deb52c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:46.261698 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20307c-a90d-4f63-8b61-8108deb52c52 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:46.261980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20307c-a90d-4f63-8b61-8108deb52c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:46.262254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20307c-a90d-4f63-8b61-8108deb52c52 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:46.263496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20307c-a90d-4f63-8b61-8108deb52c52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:46.265283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20307c-a90d-4f63-8b61-8108deb52c52 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:46.266844 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 543/1107] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:46.272534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f9ac0-f32f-4f1c-b157-443f582eb726 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:46.281729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f9ac0-f32f-4f1c-b157-443f582eb726 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:46.286139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d079b-71cd-40c2-9a74-71e14513bcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:46.286815 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d079b-71cd-40c2-9a74-71e14513bcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:46.287094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d079b-71cd-40c2-9a74-71e14513bcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:46.287364 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d079b-71cd-40c2-9a74-71e14513bcd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:46.288072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d079b-71cd-40c2-9a74-71e14513bcd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:46.289948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d079b-71cd-40c2-9a74-71e14513bcd1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:46.309906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 565/1108] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:57:46 2021] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:48.682274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbcb4d-ab51-472e-857f-baca7cd8d45d None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:48.682836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbcb4d-ab51-472e-857f-baca7cd8d45d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:48.682836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbcb4d-ab51-472e-857f-baca7cd8d45d None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:48.684583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 544/1109] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:48.690544 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a6450-aa1c-41d6-bddc-81313333a1a0 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:48.690914 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a6450-aa1c-41d6-bddc-81313333a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:48.691095 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a6450-aa1c-41d6-bddc-81313333a1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:48.708922 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-419a6450-aa1c-41d6-bddc-81313333a1a0 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:48.710095 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-419a6450-aa1c-41d6-bddc-81313333a1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:48.717530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 566/1110] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:48.743160 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbcb4d-ab51-472e-857f-baca7cd8d45d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:48.755468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbcb4d-ab51-472e-857f-baca7cd8d45d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:48.759784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67502fd7-1908-4908-9c91-2f31069265b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:48.760600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67502fd7-1908-4908-9c91-2f31069265b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:48.760881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67502fd7-1908-4908-9c91-2f31069265b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:48.761156 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67502fd7-1908-4908-9c91-2f31069265b2 admin admin] PATH_INFO: `/v3/roles/1dbfc98083ce41ea943fbb3de6be133e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:48.762643 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67502fd7-1908-4908-9c91-2f31069265b2 admin admin] RBAC: Authorizing `identity:get_role(role_id=1dbfc98083ce41ea943fbb3de6be133e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:48.763646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-67502fd7-1908-4908-9c91-2f31069265b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:57:48.763646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:57:48.763646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:57:48.765008 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67502fd7-1908-4908-9c91-2f31069265b2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:48.766919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 545/1111] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:57:48 2021] GET /identity/v3/roles/1dbfc98083ce41ea943fbb3de6be133e => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:48.772744 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a6450-aa1c-41d6-bddc-81313333a1a0 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:48.781932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a6450-aa1c-41d6-bddc-81313333a1a0 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:48.786316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01987f5-35ae-4473-813c-476e10320cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:48.787178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01987f5-35ae-4473-813c-476e10320cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:48.787458 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01987f5-35ae-4473-813c-476e10320cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:48.787727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01987f5-35ae-4473-813c-476e10320cb2 admin admin] PATH_INFO: `/v3/users/5b46d8fed760476a8bca163350f76515` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:48.800657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01987f5-35ae-4473-813c-476e10320cb2 admin admin] RBAC: Authorizing `identity:get_user(user_id=5b46d8fed760476a8bca163350f76515)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:48.802792 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01987f5-35ae-4473-813c-476e10320cb2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:48.804358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 567/1112] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:57:48 2021] GET /identity/v3/users/5b46d8fed760476a8bca163350f76515 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:48.810203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67502fd7-1908-4908-9c91-2f31069265b2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:48.819632 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67502fd7-1908-4908-9c91-2f31069265b2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:48.824018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5e9bf-6996-4b41-ae04-e9f43818f354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:48.824624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5e9bf-6996-4b41-ae04-e9f43818f354 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:48.824901 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5e9bf-6996-4b41-ae04-e9f43818f354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:48.825170 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5e9bf-6996-4b41-ae04-e9f43818f354 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:48.833410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5e9bf-6996-4b41-ae04-e9f43818f354 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:48.835133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5e9bf-6996-4b41-ae04-e9f43818f354 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:48.844142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 546/1113] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:48 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:57:48.850406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01987f5-35ae-4473-813c-476e10320cb2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:48.860099 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01987f5-35ae-4473-813c-476e10320cb2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:48.864738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1a12a-fc3c-4444-a626-79fa732782ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:48.865566 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a12a-fc3c-4444-a626-79fa732782ee admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:48.865841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a12a-fc3c-4444-a626-79fa732782ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:48.866110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a12a-fc3c-4444-a626-79fa732782ee admin admin] PATH_INFO: `/v3/projects/b2de1de0373446d4801b7411abd7aeeb` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:48.867295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1a12a-fc3c-4444-a626-79fa732782ee admin admin] RBAC: Authorizing `identity:get_project(project_id=b2de1de0373446d4801b7411abd7aeeb)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:48.869297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1a12a-fc3c-4444-a626-79fa732782ee admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:48.870936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 568/1114] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:57:48 2021] GET /identity/v3/projects/b2de1de0373446d4801b7411abd7aeeb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:48.877154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5e9bf-6996-4b41-ae04-e9f43818f354 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:48.885631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5e9bf-6996-4b41-ae04-e9f43818f354 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:48.890618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bd5ce-9eed-48db-ae78-2dca910058cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:48.891222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bd5ce-9eed-48db-ae78-2dca910058cc admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:48.891503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bd5ce-9eed-48db-ae78-2dca910058cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:48.891777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bd5ce-9eed-48db-ae78-2dca910058cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:48.892599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bd5ce-9eed-48db-ae78-2dca910058cc admin admin] RBAC: Adding query filter params (role.id=1dbfc98083ce41ea943fbb3de6be133e, scope.project.id=b2de1de0373446d4801b7411abd7aeeb, user.id=5b46d8fed760476a8bca163350f76515) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:48.892908 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bd5ce-9eed-48db-ae78-2dca910058cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:48.894813 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bd5ce-9eed-48db-ae78-2dca910058cc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:48.899929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 547/1115] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:48 2021] GET /identity/v3/role_assignments?user.id=5b46d8fed760476a8bca163350f76515&scope.project.id=b2de1de0373446d4801b7411abd7aeeb&role.id=1dbfc98083ce41ea943fbb3de6be133e => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:51.225814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ed81-60a6-469e-ad8c-546b2abbfb8c None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:51.226405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ed81-60a6-469e-ad8c-546b2abbfb8c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:51.226405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ed81-60a6-469e-ad8c-546b2abbfb8c None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:51.228057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 569/1116] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:51.233723 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53e863-1a7a-4df8-aaf0-258e685abeef None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:51.234193 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53e863-1a7a-4df8-aaf0-258e685abeef None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:51.234505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53e863-1a7a-4df8-aaf0-258e685abeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:51.252583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-1d53e863-1a7a-4df8-aaf0-258e685abeef None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:51.253770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-1d53e863-1a7a-4df8-aaf0-258e685abeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:51.261324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 548/1117] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:51 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:51.285208 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319ed81-60a6-469e-ad8c-546b2abbfb8c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:51.296997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319ed81-60a6-469e-ad8c-546b2abbfb8c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:51.301239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4451135-14d2-40b7-9e34-aeb7a77aa199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:51.302052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4451135-14d2-40b7-9e34-aeb7a77aa199 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:51.302326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4451135-14d2-40b7-9e34-aeb7a77aa199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:51.302627 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4451135-14d2-40b7-9e34-aeb7a77aa199 admin admin] PATH_INFO: `/v3/roles/1dbfc98083ce41ea943fbb3de6be133e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:51.304085 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4451135-14d2-40b7-9e34-aeb7a77aa199 admin admin] RBAC: Authorizing `identity:get_role(role_id=1dbfc98083ce41ea943fbb3de6be133e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:51.305084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-c4451135-14d2-40b7-9e34-aeb7a77aa199 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:57:51.305084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 00:57:51.305084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 00:57:51.305942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4451135-14d2-40b7-9e34-aeb7a77aa199 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:51.307276 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 570/1118] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:57:51 2021] GET /identity/v3/roles/1dbfc98083ce41ea943fbb3de6be133e => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:51.313727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53e863-1a7a-4df8-aaf0-258e685abeef None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:51.322532 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53e863-1a7a-4df8-aaf0-258e685abeef None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:51.326926 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da8e53-53b2-44d5-a5bc-a2b76e1baba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:51.328846 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da8e53-53b2-44d5-a5bc-a2b76e1baba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:51.329128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da8e53-53b2-44d5-a5bc-a2b76e1baba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:51.329403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da8e53-53b2-44d5-a5bc-a2b76e1baba3 admin admin] PATH_INFO: `/v3/users/5b46d8fed760476a8bca163350f76515` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:51.330654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da8e53-53b2-44d5-a5bc-a2b76e1baba3 admin admin] RBAC: Authorizing `identity:get_user(user_id=5b46d8fed760476a8bca163350f76515)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:51.332730 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da8e53-53b2-44d5-a5bc-a2b76e1baba3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:51.334258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 549/1119] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:57:51 2021] GET /identity/v3/users/5b46d8fed760476a8bca163350f76515 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:51.339827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4451135-14d2-40b7-9e34-aeb7a77aa199 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:51.349005 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4451135-14d2-40b7-9e34-aeb7a77aa199 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:51.353352 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f2ee2-96de-4991-a16f-8c016bd8623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:51.354132 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f2ee2-96de-4991-a16f-8c016bd8623b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:51.354435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f2ee2-96de-4991-a16f-8c016bd8623b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:51.354708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f2ee2-96de-4991-a16f-8c016bd8623b admin admin] PATH_INFO: `/v3/projects/b2de1de0373446d4801b7411abd7aeeb` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:51.355850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f2ee2-96de-4991-a16f-8c016bd8623b admin admin] RBAC: Authorizing `identity:get_project(project_id=b2de1de0373446d4801b7411abd7aeeb)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:51.357805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f2ee2-96de-4991-a16f-8c016bd8623b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:51.359408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 571/1120] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:57:51 2021] GET /identity/v3/projects/b2de1de0373446d4801b7411abd7aeeb => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:51.365365 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da8e53-53b2-44d5-a5bc-a2b76e1baba3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:51.375099 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da8e53-53b2-44d5-a5bc-a2b76e1baba3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:51.379538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d7302-a243-4af2-ba88-5ad7edb8d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:51.380360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7302-a243-4af2-ba88-5ad7edb8d76e admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:51.380639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7302-a243-4af2-ba88-5ad7edb8d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:51.380911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7302-a243-4af2-ba88-5ad7edb8d76e admin admin] PATH_INFO: `/v3/projects/b2de1de0373446d4801b7411abd7aeeb/users/5b46d8fed760476a8bca163350f76515/roles/1dbfc98083ce41ea943fbb3de6be133e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:51.383101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d7302-a243-4af2-ba88-5ad7edb8d76e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2de1de0373446d4801b7411abd7aeeb, user_id=5b46d8fed760476a8bca163350f76515, role_id=1dbfc98083ce41ea943fbb3de6be133e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:51.385652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d7302-a243-4af2-ba88-5ad7edb8d76e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:51.399140 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 550/1121] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:57:51 2021] PUT /identity/v3/projects/b2de1de0373446d4801b7411abd7aeeb/users/5b46d8fed760476a8bca163350f76515/roles/1dbfc98083ce41ea943fbb3de6be133e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:57:53.706928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364b20-fa4f-4201-94fa-438c3f549c46 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:53.707498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364b20-fa4f-4201-94fa-438c3f549c46 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:53.707498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364b20-fa4f-4201-94fa-438c3f549c46 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:53.709235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 572/1122] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:53.714838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f3dd5-7d91-4636-aa79-2623b4d54d99 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:53.715232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f3dd5-7d91-4636-aa79-2623b4d54d99 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:53.715390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f3dd5-7d91-4636-aa79-2623b4d54d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:53.732497 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-665f3dd5-7d91-4636-aa79-2623b4d54d99 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:53.733805 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-665f3dd5-7d91-4636-aa79-2623b4d54d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:53.789274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 551/1123] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:53.814585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364b20-fa4f-4201-94fa-438c3f549c46 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:53.827262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364b20-fa4f-4201-94fa-438c3f549c46 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:53.832067 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a6b4e-0d89-46f9-b87f-a67242aa5484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:53.832894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a6b4e-0d89-46f9-b87f-a67242aa5484 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:53.833175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a6b4e-0d89-46f9-b87f-a67242aa5484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:53.833450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a6b4e-0d89-46f9-b87f-a67242aa5484 admin admin] PATH_INFO: `/v3/roles/1dbfc98083ce41ea943fbb3de6be133e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:53.834955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a6b4e-0d89-46f9-b87f-a67242aa5484 admin admin] RBAC: Authorizing `identity:get_role(role_id=1dbfc98083ce41ea943fbb3de6be133e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:53.836527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a6b4e-0d89-46f9-b87f-a67242aa5484 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:53.837832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 573/1124] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:57:53 2021] GET /identity/v3/roles/1dbfc98083ce41ea943fbb3de6be133e => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:53.844015 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f3dd5-7d91-4636-aa79-2623b4d54d99 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:53.852822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f3dd5-7d91-4636-aa79-2623b4d54d99 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:53.857311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793045cc-9f5b-462c-98c7-55f6f53e76ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:53.858919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793045cc-9f5b-462c-98c7-55f6f53e76ec admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:53.859436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793045cc-9f5b-462c-98c7-55f6f53e76ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:53.859743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793045cc-9f5b-462c-98c7-55f6f53e76ec admin admin] PATH_INFO: `/v3/users/5b46d8fed760476a8bca163350f76515` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:53.861199 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793045cc-9f5b-462c-98c7-55f6f53e76ec admin admin] RBAC: Authorizing `identity:get_user(user_id=5b46d8fed760476a8bca163350f76515)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:53.863322 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793045cc-9f5b-462c-98c7-55f6f53e76ec admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:53.864860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 552/1125] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:57:53 2021] GET /identity/v3/users/5b46d8fed760476a8bca163350f76515 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:53.870784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a6b4e-0d89-46f9-b87f-a67242aa5484 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:53.880814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a6b4e-0d89-46f9-b87f-a67242aa5484 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:53.885295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c6775-1a03-4312-8d8e-3fe9b1d5ecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:53.885912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6775-1a03-4312-8d8e-3fe9b1d5ecca admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:53.886193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6775-1a03-4312-8d8e-3fe9b1d5ecca admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:53.886582 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6775-1a03-4312-8d8e-3fe9b1d5ecca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:53.894591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c6775-1a03-4312-8d8e-3fe9b1d5ecca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:53.896312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c6775-1a03-4312-8d8e-3fe9b1d5ecca admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:53.904908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 574/1126] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:57:53 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:57:53.910820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793045cc-9f5b-462c-98c7-55f6f53e76ec admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:53.920099 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793045cc-9f5b-462c-98c7-55f6f53e76ec admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:53.925006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855157e-4b0e-432f-83c1-4e333db7a6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:53.925806 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855157e-4b0e-432f-83c1-4e333db7a6cc admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:53.926084 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855157e-4b0e-432f-83c1-4e333db7a6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:53.926353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855157e-4b0e-432f-83c1-4e333db7a6cc admin admin] PATH_INFO: `/v3/projects/b2de1de0373446d4801b7411abd7aeeb` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:53.927530 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855157e-4b0e-432f-83c1-4e333db7a6cc admin admin] RBAC: Authorizing `identity:get_project(project_id=b2de1de0373446d4801b7411abd7aeeb)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:53.929515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855157e-4b0e-432f-83c1-4e333db7a6cc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:53.931131 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 553/1127] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:57:53 2021] GET /identity/v3/projects/b2de1de0373446d4801b7411abd7aeeb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:53.937844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c6775-1a03-4312-8d8e-3fe9b1d5ecca admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:53.946306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c6775-1a03-4312-8d8e-3fe9b1d5ecca admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:53.950782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4f87-db16-496e-b573-1174d0a5ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:53.951382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4f87-db16-496e-b573-1174d0a5ded5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:53.951657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4f87-db16-496e-b573-1174d0a5ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:53.951953 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4f87-db16-496e-b573-1174d0a5ded5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:53.952767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf4f87-db16-496e-b573-1174d0a5ded5 admin admin] RBAC: Adding query filter params (role.id=1dbfc98083ce41ea943fbb3de6be133e, scope.project.id=b2de1de0373446d4801b7411abd7aeeb, user.id=5b46d8fed760476a8bca163350f76515) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:57:53.953068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf4f87-db16-496e-b573-1174d0a5ded5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:53.954882 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf4f87-db16-496e-b573-1174d0a5ded5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:53.960432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 575/1128] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:57:53 2021] GET /identity/v3/role_assignments?user.id=5b46d8fed760476a8bca163350f76515&scope.project.id=b2de1de0373446d4801b7411abd7aeeb&role.id=1dbfc98083ce41ea943fbb3de6be133e => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:56.347140 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1aed9-4b73-47e9-8736-426c110709e0 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:56.347710 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1aed9-4b73-47e9-8736-426c110709e0 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:56.347710 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1aed9-4b73-47e9-8736-426c110709e0 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:56.349545 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 554/1129] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:56.355364 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa18ca-f8cd-42bb-a752-7da5c5ad26d4 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:56.355797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa18ca-f8cd-42bb-a752-7da5c5ad26d4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:56.355909 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa18ca-f8cd-42bb-a752-7da5c5ad26d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:56.375470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-32aa18ca-f8cd-42bb-a752-7da5c5ad26d4 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:56.376647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-32aa18ca-f8cd-42bb-a752-7da5c5ad26d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:56.384172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 576/1130] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:56.408305 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1aed9-4b73-47e9-8736-426c110709e0 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:56.420042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1aed9-4b73-47e9-8736-426c110709e0 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:56.425165 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83912-636c-478e-b570-db77e7583d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:56.425920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83912-636c-478e-b570-db77e7583d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:56.426197 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83912-636c-478e-b570-db77e7583d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:56.426499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83912-636c-478e-b570-db77e7583d0a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:56.427663 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d83912-636c-478e-b570-db77e7583d0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:56.429318 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d83912-636c-478e-b570-db77e7583d0a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:56.430868 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 555/1131] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:56.436653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa18ca-f8cd-42bb-a752-7da5c5ad26d4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:56.446239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa18ca-f8cd-42bb-a752-7da5c5ad26d4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:56.450751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86801c-6b4a-491e-9857-95ad60b0128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:56.451381 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86801c-6b4a-491e-9857-95ad60b0128d admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:56.451658 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86801c-6b4a-491e-9857-95ad60b0128d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:56.452047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86801c-6b4a-491e-9857-95ad60b0128d admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:56.452723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86801c-6b4a-491e-9857-95ad60b0128d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:56.454622 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86801c-6b4a-491e-9857-95ad60b0128d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:56.478291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 577/1132] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:57:56 2021] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:57:58.873490 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1b2b-2f37-4c1a-be0c-c9b4f08e9bf6 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:58.873969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1b2b-2f37-4c1a-be0c-c9b4f08e9bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:58.874201 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1b2b-2f37-4c1a-be0c-c9b4f08e9bf6 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:58.875920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 556/1133] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:57:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:57:58.881692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c9b6c-6738-4bb1-aa49-6cdc4c575730 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:58.882085 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c9b6c-6738-4bb1-aa49-6cdc4c575730 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:58.882251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c9b6c-6738-4bb1-aa49-6cdc4c575730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:58.900140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a29c9b6c-6738-4bb1-aa49-6cdc4c575730 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:57:58.901323 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a29c9b6c-6738-4bb1-aa49-6cdc4c575730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:57:58.956669 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 578/1134] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:57:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:57:58.983685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c1b2b-2f37-4c1a-be0c-c9b4f08e9bf6 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:58.995763 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c1b2b-2f37-4c1a-be0c-c9b4f08e9bf6 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:59.000083 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132164f-c00b-414d-b13b-33619ad1e499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:59.000836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132164f-c00b-414d-b13b-33619ad1e499 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:59.001234 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132164f-c00b-414d-b13b-33619ad1e499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:59.001509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132164f-c00b-414d-b13b-33619ad1e499 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:59.002692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132164f-c00b-414d-b13b-33619ad1e499 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:59.004352 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132164f-c00b-414d-b13b-33619ad1e499 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:59.005856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 557/1135] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:57:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:57:59.011527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c9b6c-6738-4bb1-aa49-6cdc4c575730 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:57:59.020547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c9b6c-6738-4bb1-aa49-6cdc4c575730 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:57:59.025062 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e6793-c820-4bbb-9bd1-a2f8f615f79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:57:59.025710 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e6793-c820-4bbb-9bd1-a2f8f615f79e admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:57:59.025991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e6793-c820-4bbb-9bd1-a2f8f615f79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:57:59.026265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e6793-c820-4bbb-9bd1-a2f8f615f79e admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:57:59.027010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e6793-c820-4bbb-9bd1-a2f8f615f79e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:57:59.028902 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e6793-c820-4bbb-9bd1-a2f8f615f79e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:57:59.049684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 579/1136] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:57:59 2021] POST /identity/v3/users => generated 286 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:58:01.421242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb608d4b-a98e-4327-9522-4938939c7826 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:01.421802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb608d4b-a98e-4327-9522-4938939c7826 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:01.421802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb608d4b-a98e-4327-9522-4938939c7826 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:01.423577 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 558/1137] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:58:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:58:01.431034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789dd66-7fa4-4217-a707-2853b4a9d24a None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:01.431519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789dd66-7fa4-4217-a707-2853b4a9d24a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:01.432040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789dd66-7fa4-4217-a707-2853b4a9d24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:01.455043 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-b789dd66-7fa4-4217-a707-2853b4a9d24a None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:58:01.456264 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b789dd66-7fa4-4217-a707-2853b4a9d24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:58:01.463939 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 580/1138] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:58:01 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:58:01.490003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb608d4b-a98e-4327-9522-4938939c7826 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:01.502028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb608d4b-a98e-4327-9522-4938939c7826 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:01.506249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36e225-b4ae-4558-b661-9e47169a382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:01.507032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36e225-b4ae-4558-b661-9e47169a382a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:01.507309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36e225-b4ae-4558-b661-9e47169a382a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:01.507577 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36e225-b4ae-4558-b661-9e47169a382a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:01.518074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36e225-b4ae-4558-b661-9e47169a382a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:58:01.524794 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-4f36e225-b4ae-4558-b661-9e47169a382a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:58:01.525892 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 559/1139] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:58:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:58:01.532965 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789dd66-7fa4-4217-a707-2853b4a9d24a None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:01.541709 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789dd66-7fa4-4217-a707-2853b4a9d24a None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:01.546477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4faa0b-e8cc-46b0-973b-3912bfa204e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:01.547119 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4faa0b-e8cc-46b0-973b-3912bfa204e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:01.547400 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4faa0b-e8cc-46b0-973b-3912bfa204e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:01.547672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4faa0b-e8cc-46b0-973b-3912bfa204e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:01.548432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4faa0b-e8cc-46b0-973b-3912bfa204e8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:58:01.548738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4faa0b-e8cc-46b0-973b-3912bfa204e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:01.550311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4faa0b-e8cc-46b0-973b-3912bfa204e8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:01.558264 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 581/1140] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:58:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:01.564146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36e225-b4ae-4558-b661-9e47169a382a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:01.573748 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36e225-b4ae-4558-b661-9e47169a382a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:01.578615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a49b13-8207-467a-8509-00e100a5d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:01.579419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a49b13-8207-467a-8509-00e100a5d595 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:01.579697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a49b13-8207-467a-8509-00e100a5d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:01.579965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a49b13-8207-467a-8509-00e100a5d595 admin admin] PATH_INFO: `/v3/users/5ad17678ec864d82bbeb921b09661364` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:01.592154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a49b13-8207-467a-8509-00e100a5d595 admin admin] RBAC: Authorizing `identity:get_user(user_id=5ad17678ec864d82bbeb921b09661364)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:01.594790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a49b13-8207-467a-8509-00e100a5d595 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:01.596363 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 560/1141] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:58:01 2021] GET /identity/v3/users/5ad17678ec864d82bbeb921b09661364 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:01.602123 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4faa0b-e8cc-46b0-973b-3912bfa204e8 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:01.611711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4faa0b-e8cc-46b0-973b-3912bfa204e8 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:01.616184 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f9799-1b49-4f36-a062-ba323d386177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:01.616796 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9799-1b49-4f36-a062-ba323d386177 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:01.617078 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9799-1b49-4f36-a062-ba323d386177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:01.617357 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9799-1b49-4f36-a062-ba323d386177 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:01.624908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f9799-1b49-4f36-a062-ba323d386177 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:01.626643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f9799-1b49-4f36-a062-ba323d386177 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:01.635583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 582/1142] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:58:01 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:58:01.641860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a49b13-8207-467a-8509-00e100a5d595 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:01.650938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a49b13-8207-467a-8509-00e100a5d595 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:01.655977 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42619a9c-210e-43e9-8af7-6e01ba51c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:01.656787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42619a9c-210e-43e9-8af7-6e01ba51c2bd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:01.657061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42619a9c-210e-43e9-8af7-6e01ba51c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:01.657329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42619a9c-210e-43e9-8af7-6e01ba51c2bd admin admin] PATH_INFO: `/v3/projects/8c30c83768cb4f4c88a295656de4b8c4` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:01.658506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42619a9c-210e-43e9-8af7-6e01ba51c2bd admin admin] RBAC: Authorizing `identity:get_project(project_id=8c30c83768cb4f4c88a295656de4b8c4)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:01.660454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42619a9c-210e-43e9-8af7-6e01ba51c2bd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:01.662009 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 561/1143] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:58:01 2021] GET /identity/v3/projects/8c30c83768cb4f4c88a295656de4b8c4 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:01.668151 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f9799-1b49-4f36-a062-ba323d386177 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:01.676608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f9799-1b49-4f36-a062-ba323d386177 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:01.681118 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96b486-1b86-4e81-a844-54465b1f8726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:01.681720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96b486-1b86-4e81-a844-54465b1f8726 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:01.682003 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96b486-1b86-4e81-a844-54465b1f8726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:01.682280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96b486-1b86-4e81-a844-54465b1f8726 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:01.683134 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96b486-1b86-4e81-a844-54465b1f8726 admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=8c30c83768cb4f4c88a295656de4b8c4, user.id=5ad17678ec864d82bbeb921b09661364) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:58:01.683444 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96b486-1b86-4e81-a844-54465b1f8726 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:01.685218 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96b486-1b86-4e81-a844-54465b1f8726 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:01.690864 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 583/1144] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:58:01 2021] GET /identity/v3/role_assignments?user.id=5ad17678ec864d82bbeb921b09661364&scope.project.id=8c30c83768cb4f4c88a295656de4b8c4&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:03.986422 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075f113-46ba-4162-b799-8897adc7af13 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:03.986980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075f113-46ba-4162-b799-8897adc7af13 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:03.986980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075f113-46ba-4162-b799-8897adc7af13 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:03.988697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 562/1145] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:58:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:58:03.994341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2efe2-a1dd-4b0c-8630-a87bfdca7fdc None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:03.994785 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2efe2-a1dd-4b0c-8630-a87bfdca7fdc None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:03.994928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2efe2-a1dd-4b0c-8630-a87bfdca7fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:04.013756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-3ab2efe2-a1dd-4b0c-8630-a87bfdca7fdc None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:58:04.016623 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-3ab2efe2-a1dd-4b0c-8630-a87bfdca7fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:58:04.025423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 584/1146] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:58:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:58:04.049658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075f113-46ba-4162-b799-8897adc7af13 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:04.062008 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075f113-46ba-4162-b799-8897adc7af13 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:04.066244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edc134-bcae-43a5-b642-c39bc52d56ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:04.067032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edc134-bcae-43a5-b642-c39bc52d56ba admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:04.067311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edc134-bcae-43a5-b642-c39bc52d56ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:04.067579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edc134-bcae-43a5-b642-c39bc52d56ba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:04.077865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edc134-bcae-43a5-b642-c39bc52d56ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:58:04.084552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-43edc134-bcae-43a5-b642-c39bc52d56ba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:58:04.085694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 563/1147] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:58:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:58:04.092650 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2efe2-a1dd-4b0c-8630-a87bfdca7fdc None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:04.101638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2efe2-a1dd-4b0c-8630-a87bfdca7fdc None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:04.106082 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cacd4-0a36-470f-8d3a-590dc2ac42ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:04.106770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cacd4-0a36-470f-8d3a-590dc2ac42ec admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:04.107055 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cacd4-0a36-470f-8d3a-590dc2ac42ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:04.107333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cacd4-0a36-470f-8d3a-590dc2ac42ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:04.108088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cacd4-0a36-470f-8d3a-590dc2ac42ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:58:04.108395 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cacd4-0a36-470f-8d3a-590dc2ac42ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:04.109985 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cacd4-0a36-470f-8d3a-590dc2ac42ec admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:04.118192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 585/1148] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:58:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:04.124742 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edc134-bcae-43a5-b642-c39bc52d56ba admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:04.135166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edc134-bcae-43a5-b642-c39bc52d56ba admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:04.140445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72ddb9-514b-4109-90a4-3422d9676a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:04.141273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72ddb9-514b-4109-90a4-3422d9676a57 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:04.141550 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72ddb9-514b-4109-90a4-3422d9676a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:04.141819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72ddb9-514b-4109-90a4-3422d9676a57 admin admin] PATH_INFO: `/v3/users/5ad17678ec864d82bbeb921b09661364` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:04.143008 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72ddb9-514b-4109-90a4-3422d9676a57 admin admin] RBAC: Authorizing `identity:get_user(user_id=5ad17678ec864d82bbeb921b09661364)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:04.145087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72ddb9-514b-4109-90a4-3422d9676a57 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:04.146636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 564/1149] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:58:04 2021] GET /identity/v3/users/5ad17678ec864d82bbeb921b09661364 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:04.152639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cacd4-0a36-470f-8d3a-590dc2ac42ec admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:04.162051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cacd4-0a36-470f-8d3a-590dc2ac42ec admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:04.166516 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49e90b-d6c1-468b-a911-ecfa6183527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:04.167342 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49e90b-d6c1-468b-a911-ecfa6183527a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:04.167625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49e90b-d6c1-468b-a911-ecfa6183527a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:04.167900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49e90b-d6c1-468b-a911-ecfa6183527a admin admin] PATH_INFO: `/v3/projects/8c30c83768cb4f4c88a295656de4b8c4` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:04.169081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49e90b-d6c1-468b-a911-ecfa6183527a admin admin] RBAC: Authorizing `identity:get_project(project_id=8c30c83768cb4f4c88a295656de4b8c4)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:04.171283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49e90b-d6c1-468b-a911-ecfa6183527a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:04.172891 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 586/1150] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:58:04 2021] GET /identity/v3/projects/8c30c83768cb4f4c88a295656de4b8c4 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:58:04.178718 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72ddb9-514b-4109-90a4-3422d9676a57 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:04.188559 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72ddb9-514b-4109-90a4-3422d9676a57 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:04.193034 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8ce78-c6a2-4e61-a88e-6604a8468a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:04.193875 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8ce78-c6a2-4e61-a88e-6604a8468a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:04.194156 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8ce78-c6a2-4e61-a88e-6604a8468a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:04.194458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8ce78-c6a2-4e61-a88e-6604a8468a47 admin admin] PATH_INFO: `/v3/projects/8c30c83768cb4f4c88a295656de4b8c4/users/5ad17678ec864d82bbeb921b09661364/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:04.196438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8ce78-c6a2-4e61-a88e-6604a8468a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c30c83768cb4f4c88a295656de4b8c4, user_id=5ad17678ec864d82bbeb921b09661364, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:04.199060 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8ce78-c6a2-4e61-a88e-6604a8468a47 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:04.212041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 565/1151] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:58:04 2021] PUT /identity/v3/projects/8c30c83768cb4f4c88a295656de4b8c4/users/5ad17678ec864d82bbeb921b09661364/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:58:06.522905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213a73-aeba-4160-bceb-fa0c108fba2d None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:06.523498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213a73-aeba-4160-bceb-fa0c108fba2d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:06.523498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213a73-aeba-4160-bceb-fa0c108fba2d None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:06.525202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 587/1152] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:58:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:58:06.530928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d532b2a-a59a-468e-9af6-4e533c5cd970 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:06.531345 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d532b2a-a59a-468e-9af6-4e533c5cd970 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:06.531486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d532b2a-a59a-468e-9af6-4e533c5cd970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:06.549072 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-5d532b2a-a59a-468e-9af6-4e533c5cd970 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:58:06.550249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5d532b2a-a59a-468e-9af6-4e533c5cd970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:58:06.607357 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 566/1153] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:58:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:58:06.632878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213a73-aeba-4160-bceb-fa0c108fba2d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:06.645061 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213a73-aeba-4160-bceb-fa0c108fba2d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:06.649389 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fa999-9587-4112-aa2f-04e8de79871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:06.650151 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fa999-9587-4112-aa2f-04e8de79871c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:06.650465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fa999-9587-4112-aa2f-04e8de79871c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:06.650742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fa999-9587-4112-aa2f-04e8de79871c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:06.660755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fa999-9587-4112-aa2f-04e8de79871c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:58:06.667556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-4d0fa999-9587-4112-aa2f-04e8de79871c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:58:06.668697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 588/1154] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:58:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:58:06.676820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d532b2a-a59a-468e-9af6-4e533c5cd970 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:06.685510 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d532b2a-a59a-468e-9af6-4e533c5cd970 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:06.690783 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd040694-d552-457b-bd90-480c9688fafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:06.691425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd040694-d552-457b-bd90-480c9688fafc admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:06.691703 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd040694-d552-457b-bd90-480c9688fafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:06.691975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd040694-d552-457b-bd90-480c9688fafc admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:06.692713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd040694-d552-457b-bd90-480c9688fafc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:58:06.693014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd040694-d552-457b-bd90-480c9688fafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:06.694613 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd040694-d552-457b-bd90-480c9688fafc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:06.702681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 567/1155] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:58:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:06.708944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fa999-9587-4112-aa2f-04e8de79871c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:06.718972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fa999-9587-4112-aa2f-04e8de79871c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:06.723438 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860385-1b75-49f5-be91-8d6f0e8b2260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:06.724266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860385-1b75-49f5-be91-8d6f0e8b2260 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:06.724546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860385-1b75-49f5-be91-8d6f0e8b2260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:06.724820 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860385-1b75-49f5-be91-8d6f0e8b2260 admin admin] PATH_INFO: `/v3/users/5ad17678ec864d82bbeb921b09661364` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:06.726020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf860385-1b75-49f5-be91-8d6f0e8b2260 admin admin] RBAC: Authorizing `identity:get_user(user_id=5ad17678ec864d82bbeb921b09661364)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:06.728161 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf860385-1b75-49f5-be91-8d6f0e8b2260 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:06.729716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 589/1156] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:58:06 2021] GET /identity/v3/users/5ad17678ec864d82bbeb921b09661364 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:06.736287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd040694-d552-457b-bd90-480c9688fafc admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:06.745388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd040694-d552-457b-bd90-480c9688fafc admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:06.750409 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53353678-76ea-48e0-84be-04542e8b472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:06.751020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53353678-76ea-48e0-84be-04542e8b472a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:06.751298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53353678-76ea-48e0-84be-04542e8b472a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:06.751569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53353678-76ea-48e0-84be-04542e8b472a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:06.759226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53353678-76ea-48e0-84be-04542e8b472a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:06.760935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53353678-76ea-48e0-84be-04542e8b472a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:06.769978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 568/1157] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:58:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:58:06.775821 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860385-1b75-49f5-be91-8d6f0e8b2260 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:06.785000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860385-1b75-49f5-be91-8d6f0e8b2260 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:06.789446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ebd89-43cd-4fca-a0c8-6a2927e96ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:06.790242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ebd89-43cd-4fca-a0c8-6a2927e96ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:06.790564 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ebd89-43cd-4fca-a0c8-6a2927e96ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:06.790838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ebd89-43cd-4fca-a0c8-6a2927e96ba6 admin admin] PATH_INFO: `/v3/projects/8c30c83768cb4f4c88a295656de4b8c4` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:06.792002 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ebd89-43cd-4fca-a0c8-6a2927e96ba6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8c30c83768cb4f4c88a295656de4b8c4)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:06.793986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ebd89-43cd-4fca-a0c8-6a2927e96ba6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:06.796155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 590/1158] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:58:06 2021] GET /identity/v3/projects/8c30c83768cb4f4c88a295656de4b8c4 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:06.802029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53353678-76ea-48e0-84be-04542e8b472a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:06.810280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53353678-76ea-48e0-84be-04542e8b472a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:06.815363 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149b13f-de9a-4461-aa1a-60ba3daf39f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:06.815957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149b13f-de9a-4461-aa1a-60ba3daf39f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:06.816234 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149b13f-de9a-4461-aa1a-60ba3daf39f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:06.816505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149b13f-de9a-4461-aa1a-60ba3daf39f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:06.817312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149b13f-de9a-4461-aa1a-60ba3daf39f7 admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=8c30c83768cb4f4c88a295656de4b8c4, user.id=5ad17678ec864d82bbeb921b09661364) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:58:06.817616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149b13f-de9a-4461-aa1a-60ba3daf39f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:06.819440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149b13f-de9a-4461-aa1a-60ba3daf39f7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:06.824930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 569/1159] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:58:06 2021] GET /identity/v3/role_assignments?user.id=5ad17678ec864d82bbeb921b09661364&scope.project.id=8c30c83768cb4f4c88a295656de4b8c4&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:09.149839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c9093-996b-4f72-bc5c-2646a59cf94c None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:09.150349 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c9093-996b-4f72-bc5c-2646a59cf94c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:09.150349 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c9093-996b-4f72-bc5c-2646a59cf94c None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:09.152112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 591/1160] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:58:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:58:09.158745 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5020987-6332-412c-9c9d-6c732c88c87e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:09.159186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5020987-6332-412c-9c9d-6c732c88c87e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:09.159288 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5020987-6332-412c-9c9d-6c732c88c87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:09.176310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-a5020987-6332-412c-9c9d-6c732c88c87e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:58:09.177471 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a5020987-6332-412c-9c9d-6c732c88c87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:58:09.184871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 570/1161] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:58:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:58:09.208335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c9093-996b-4f72-bc5c-2646a59cf94c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:09.220362 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c9093-996b-4f72-bc5c-2646a59cf94c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:09.224671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f0e4e-167b-4e07-99e5-8688f01e98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:09.225290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f0e4e-167b-4e07-99e5-8688f01e98d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:09.225572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f0e4e-167b-4e07-99e5-8688f01e98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:09.225846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f0e4e-167b-4e07-99e5-8688f01e98d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:09.233639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f0e4e-167b-4e07-99e5-8688f01e98d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:09.235664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f0e4e-167b-4e07-99e5-8688f01e98d9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:09.244195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 592/1162] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:58:09 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:58:09.250799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5020987-6332-412c-9c9d-6c732c88c87e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:09.259304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5020987-6332-412c-9c9d-6c732c88c87e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:09.264376 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2586d-01cc-4ce5-91ed-c5542ed7a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:09.265213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2586d-01cc-4ce5-91ed-c5542ed7a105 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:09.265493 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2586d-01cc-4ce5-91ed-c5542ed7a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:09.265762 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2586d-01cc-4ce5-91ed-c5542ed7a105 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:09.272373 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2586d-01cc-4ce5-91ed-c5542ed7a105 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:09.274141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2586d-01cc-4ce5-91ed-c5542ed7a105 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:09.288200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-d3d2586d-01cc-4ce5-91ed-c5542ed7a105 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 09 00:58:09.289314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 571/1163] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Dec 9 00:58:09 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:58:09.296064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f0e4e-167b-4e07-99e5-8688f01e98d9 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:09.304789 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f0e4e-167b-4e07-99e5-8688f01e98d9 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:09.309289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289a2c-c719-4d01-8171-760636c7fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:09.309916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289a2c-c719-4d01-8171-760636c7fdff admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:09.310199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289a2c-c719-4d01-8171-760636c7fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:09.310507 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289a2c-c719-4d01-8171-760636c7fdff admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:09.311982 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289a2c-c719-4d01-8171-760636c7fdff admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:58:09.312286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289a2c-c719-4d01-8171-760636c7fdff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:09.313860 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289a2c-c719-4d01-8171-760636c7fdff admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:09.320835 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 593/1164] 10.222.0.23 () {56 vars in 1136 bytes} [Thu Dec 9 00:58:09 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:11.630750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2c24b-c8a4-4a07-801d-d397ba08aa3b None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:11.631269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2c24b-c8a4-4a07-801d-d397ba08aa3b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:11.631378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2c24b-c8a4-4a07-801d-d397ba08aa3b None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:11.633054 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 572/1165] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:58:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:58:11.638737 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120baa7e-581c-4bd3-9e89-9404d0c8a78a None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:11.639443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120baa7e-581c-4bd3-9e89-9404d0c8a78a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:11.639443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120baa7e-581c-4bd3-9e89-9404d0c8a78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:11.656873 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-120baa7e-581c-4bd3-9e89-9404d0c8a78a None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:58:11.658040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-120baa7e-581c-4bd3-9e89-9404d0c8a78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:58:11.665602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 594/1166] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:58:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:58:11.689652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2c24b-c8a4-4a07-801d-d397ba08aa3b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:11.702020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2c24b-c8a4-4a07-801d-d397ba08aa3b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:11.706315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e3d9f-b2dc-4c6c-9ca8-5652a79fd2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:11.706980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e3d9f-b2dc-4c6c-9ca8-5652a79fd2be admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:11.707261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e3d9f-b2dc-4c6c-9ca8-5652a79fd2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:11.707535 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e3d9f-b2dc-4c6c-9ca8-5652a79fd2be admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:11.708287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e3d9f-b2dc-4c6c-9ca8-5652a79fd2be admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:11.709288 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-c43e3d9f-b2dc-4c6c-9ca8-5652a79fd2be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 00:58:11.709288 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 00:58:11.709288 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 00:58:11.710173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e3d9f-b2dc-4c6c-9ca8-5652a79fd2be admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:11.724900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 573/1167] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Dec 9 00:58:11 2021] POST /identity/v3/domains => generated 267 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:58:14.166560 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f4733-709e-478f-a42e-5d545a14ffc5 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:14.167080 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f4733-709e-478f-a42e-5d545a14ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:14.167080 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f4733-709e-478f-a42e-5d545a14ffc5 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:14.168807 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 595/1168] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:58:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:58:14.175176 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb528004-ae38-4651-83f8-0306fc31c175 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:14.175564 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb528004-ae38-4651-83f8-0306fc31c175 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:14.175735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb528004-ae38-4651-83f8-0306fc31c175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:14.193580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-eb528004-ae38-4651-83f8-0306fc31c175 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:58:14.194811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-eb528004-ae38-4651-83f8-0306fc31c175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:58:14.249327 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 574/1169] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:58:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:58:14.273157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f4733-709e-478f-a42e-5d545a14ffc5 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:14.285347 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f4733-709e-478f-a42e-5d545a14ffc5 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:14.289566 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f11b2b-12c4-4930-9688-ffde428e68c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:14.290406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f11b2b-12c4-4930-9688-ffde428e68c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:14.290686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f11b2b-12c4-4930-9688-ffde428e68c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:14.290958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f11b2b-12c4-4930-9688-ffde428e68c6 admin admin] PATH_INFO: `/v3/domains/4c320537a684481f99fd95ab6408add9` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:14.301538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f11b2b-12c4-4930-9688-ffde428e68c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=4c320537a684481f99fd95ab6408add9)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:14.303506 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f11b2b-12c4-4930-9688-ffde428e68c6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:14.305059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 596/1170] 10.222.0.23 () {56 vars in 1204 bytes} [Thu Dec 9 00:58:14 2021] GET /identity/v3/domains/4c320537a684481f99fd95ab6408add9 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:14.311992 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb528004-ae38-4651-83f8-0306fc31c175 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:14.320562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb528004-ae38-4651-83f8-0306fc31c175 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:14.324960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7f2e8-7e7e-4175-a58c-bc5ed4ee1acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:14.325597 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7f2e8-7e7e-4175-a58c-bc5ed4ee1acc admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:14.325875 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7f2e8-7e7e-4175-a58c-bc5ed4ee1acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:14.326207 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7f2e8-7e7e-4175-a58c-bc5ed4ee1acc admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:14.326981 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7f2e8-7e7e-4175-a58c-bc5ed4ee1acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:14.328832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7f2e8-7e7e-4175-a58c-bc5ed4ee1acc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:14.352504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 575/1171] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:58:14 2021] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 00:58:16.775526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e3d01-59c8-4b05-b2b8-fb9b199f5b29 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:16.776094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e3d01-59c8-4b05-b2b8-fb9b199f5b29 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:16.776094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e3d01-59c8-4b05-b2b8-fb9b199f5b29 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:16.777839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 597/1172] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:58:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:58:16.784652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41984cb2-6d9c-41b3-9dad-091452d58b56 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:16.785137 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41984cb2-6d9c-41b3-9dad-091452d58b56 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:16.785252 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41984cb2-6d9c-41b3-9dad-091452d58b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:16.805656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-41984cb2-6d9c-41b3-9dad-091452d58b56 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:58:16.806901 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-41984cb2-6d9c-41b3-9dad-091452d58b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:58:16.862780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 576/1173] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:58:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:58:16.888545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e3d01-59c8-4b05-b2b8-fb9b199f5b29 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:16.900508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e3d01-59c8-4b05-b2b8-fb9b199f5b29 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:16.905474 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcf766-66ac-4b26-8def-8c2a97f75a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:16.906311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcf766-66ac-4b26-8def-8c2a97f75a62 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:16.906633 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcf766-66ac-4b26-8def-8c2a97f75a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:16.906912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcf766-66ac-4b26-8def-8c2a97f75a62 admin admin] PATH_INFO: `/v3/domains/4c320537a684481f99fd95ab6408add9` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:16.908091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcf766-66ac-4b26-8def-8c2a97f75a62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=4c320537a684481f99fd95ab6408add9)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:16.910029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcf766-66ac-4b26-8def-8c2a97f75a62 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:16.911654 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 598/1174] 10.222.0.23 () {56 vars in 1204 bytes} [Thu Dec 9 00:58:16 2021] GET /identity/v3/domains/4c320537a684481f99fd95ab6408add9 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:16.917493 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41984cb2-6d9c-41b3-9dad-091452d58b56 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:16.926750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41984cb2-6d9c-41b3-9dad-091452d58b56 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:16.931234 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c3f57-c60c-44af-a945-e7af88ceef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:16.931882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c3f57-c60c-44af-a945-e7af88ceef5d admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:16.932161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c3f57-c60c-44af-a945-e7af88ceef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:16.932435 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c3f57-c60c-44af-a945-e7af88ceef5d admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:16.933144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c3f57-c60c-44af-a945-e7af88ceef5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:16.935069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c3f57-c60c-44af-a945-e7af88ceef5d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:16.954581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 577/1175] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:58:16 2021] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:58:19.362479 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d87197-d0bb-49ef-81c2-834862dc82b1 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:19.363032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d87197-d0bb-49ef-81c2-834862dc82b1 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:19.363032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d87197-d0bb-49ef-81c2-834862dc82b1 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:19.364795 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 599/1176] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:58:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:58:19.370515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f6117-4fbb-49eb-9ee9-6276ffcc39df None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:19.370883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f6117-4fbb-49eb-9ee9-6276ffcc39df None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:19.371064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f6117-4fbb-49eb-9ee9-6276ffcc39df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:19.388689 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-de1f6117-4fbb-49eb-9ee9-6276ffcc39df None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:58:19.389867 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-de1f6117-4fbb-49eb-9ee9-6276ffcc39df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:58:19.397494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 578/1177] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:58:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:58:19.423251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d87197-d0bb-49ef-81c2-834862dc82b1 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:19.435144 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d87197-d0bb-49ef-81c2-834862dc82b1 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:19.440383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695972e5-5cd6-43f7-98e5-ed9d0fa9de37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:19.441144 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695972e5-5cd6-43f7-98e5-ed9d0fa9de37 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:19.441423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695972e5-5cd6-43f7-98e5-ed9d0fa9de37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:19.441694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695972e5-5cd6-43f7-98e5-ed9d0fa9de37 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:19.452498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695972e5-5cd6-43f7-98e5-ed9d0fa9de37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:58:19.459256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-695972e5-5cd6-43f7-98e5-ed9d0fa9de37 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:58:19.460401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 600/1178] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:58:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:58:19.466898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f6117-4fbb-49eb-9ee9-6276ffcc39df None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:19.475671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f6117-4fbb-49eb-9ee9-6276ffcc39df None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:19.480107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8578e95-64ac-4841-bdee-a33fef74e4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:19.480748 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578e95-64ac-4841-bdee-a33fef74e4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:19.481025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578e95-64ac-4841-bdee-a33fef74e4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:19.481298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578e95-64ac-4841-bdee-a33fef74e4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:19.482583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8578e95-64ac-4841-bdee-a33fef74e4e9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:58:19.482898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8578e95-64ac-4841-bdee-a33fef74e4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:19.484465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8578e95-64ac-4841-bdee-a33fef74e4e9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:19.492642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 579/1179] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:58:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:19.499423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695972e5-5cd6-43f7-98e5-ed9d0fa9de37 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:19.508832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695972e5-5cd6-43f7-98e5-ed9d0fa9de37 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:19.513352 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baf54b-6f21-4ee7-beea-ba701989d355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:19.514263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baf54b-6f21-4ee7-beea-ba701989d355 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:19.514577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baf54b-6f21-4ee7-beea-ba701989d355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:19.514856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baf54b-6f21-4ee7-beea-ba701989d355 admin admin] PATH_INFO: `/v3/users/43ed20d6065e487db138de584bf8e704` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:19.527861 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baf54b-6f21-4ee7-beea-ba701989d355 admin admin] RBAC: Authorizing `identity:get_user(user_id=43ed20d6065e487db138de584bf8e704)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:19.529981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baf54b-6f21-4ee7-beea-ba701989d355 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:19.531600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 601/1180] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:58:19 2021] GET /identity/v3/users/43ed20d6065e487db138de584bf8e704 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:19.537579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8578e95-64ac-4841-bdee-a33fef74e4e9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:19.547476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8578e95-64ac-4841-bdee-a33fef74e4e9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:19.551974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77806e3-9879-4b02-b592-c6b9d07a6e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:19.552596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77806e3-9879-4b02-b592-c6b9d07a6e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:19.552881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77806e3-9879-4b02-b592-c6b9d07a6e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:19.553160 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77806e3-9879-4b02-b592-c6b9d07a6e83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:19.561425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77806e3-9879-4b02-b592-c6b9d07a6e83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:19.563188 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77806e3-9879-4b02-b592-c6b9d07a6e83 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:19.571839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 580/1181] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:58:19 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:58:19.577784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baf54b-6f21-4ee7-beea-ba701989d355 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:19.586977 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baf54b-6f21-4ee7-beea-ba701989d355 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:19.591578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ef4a0-4b03-472b-aa70-a09ef6a8130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:19.592378 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ef4a0-4b03-472b-aa70-a09ef6a8130c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:19.592638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ef4a0-4b03-472b-aa70-a09ef6a8130c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:19.592913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ef4a0-4b03-472b-aa70-a09ef6a8130c admin admin] PATH_INFO: `/v3/projects/7eca44daee0d43b39fda2560d17846cf` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:19.594091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ef4a0-4b03-472b-aa70-a09ef6a8130c admin admin] RBAC: Authorizing `identity:get_project(project_id=7eca44daee0d43b39fda2560d17846cf)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:19.596125 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ef4a0-4b03-472b-aa70-a09ef6a8130c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:19.597753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 602/1182] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:58:19 2021] GET /identity/v3/projects/7eca44daee0d43b39fda2560d17846cf => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:19.603711 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77806e3-9879-4b02-b592-c6b9d07a6e83 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:19.613460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77806e3-9879-4b02-b592-c6b9d07a6e83 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:19.617859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad633c47-1bfa-4163-85eb-cb5636189f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:19.618506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad633c47-1bfa-4163-85eb-cb5636189f65 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:19.618793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad633c47-1bfa-4163-85eb-cb5636189f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:19.619070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad633c47-1bfa-4163-85eb-cb5636189f65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:19.619890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad633c47-1bfa-4163-85eb-cb5636189f65 admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=7eca44daee0d43b39fda2560d17846cf, user.id=43ed20d6065e487db138de584bf8e704) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:58:19.620200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad633c47-1bfa-4163-85eb-cb5636189f65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:19.621985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad633c47-1bfa-4163-85eb-cb5636189f65 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:19.627975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 581/1183] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:58:19 2021] GET /identity/v3/role_assignments?user.id=43ed20d6065e487db138de584bf8e704&scope.project.id=7eca44daee0d43b39fda2560d17846cf&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:21.936437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85347f96-9c8c-4efb-a4b7-f13f1c07c038 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:21.936965 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85347f96-9c8c-4efb-a4b7-f13f1c07c038 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:21.936965 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85347f96-9c8c-4efb-a4b7-f13f1c07c038 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:21.938747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 603/1184] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:58:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:58:21.944578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e7e1b-6e4b-4c69-810c-acad31f81ec3 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:21.944979 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e7e1b-6e4b-4c69-810c-acad31f81ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:21.945130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e7e1b-6e4b-4c69-810c-acad31f81ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:21.964575 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b97e7e1b-6e4b-4c69-810c-acad31f81ec3 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:58:21.965762 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b97e7e1b-6e4b-4c69-810c-acad31f81ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:58:21.973376 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 582/1185] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:58:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:58:21.997220 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85347f96-9c8c-4efb-a4b7-f13f1c07c038 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:22.012668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85347f96-9c8c-4efb-a4b7-f13f1c07c038 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:22.017072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7059ab-60c9-491f-91ed-ab65a9d8132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:22.017827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7059ab-60c9-491f-91ed-ab65a9d8132c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:22.018105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7059ab-60c9-491f-91ed-ab65a9d8132c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:22.018406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7059ab-60c9-491f-91ed-ab65a9d8132c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:22.028109 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7059ab-60c9-491f-91ed-ab65a9d8132c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:58:22.035588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-4a7059ab-60c9-491f-91ed-ab65a9d8132c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:58:22.036719 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 604/1186] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:58:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:58:22.043025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e7e1b-6e4b-4c69-810c-acad31f81ec3 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:22.052343 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e7e1b-6e4b-4c69-810c-acad31f81ec3 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:22.056713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6502c1d-3214-46ec-bdbd-3c57857f5a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:22.057351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6502c1d-3214-46ec-bdbd-3c57857f5a75 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:22.057628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6502c1d-3214-46ec-bdbd-3c57857f5a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:22.057899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6502c1d-3214-46ec-bdbd-3c57857f5a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:22.058682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6502c1d-3214-46ec-bdbd-3c57857f5a75 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:58:22.058985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6502c1d-3214-46ec-bdbd-3c57857f5a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:22.060673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6502c1d-3214-46ec-bdbd-3c57857f5a75 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:22.068505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 583/1187] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:58:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:58:22.074488 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7059ab-60c9-491f-91ed-ab65a9d8132c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:22.084226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7059ab-60c9-491f-91ed-ab65a9d8132c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:22.088632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8b14a-6c3e-4a22-83d5-6cbddeba488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:22.089441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8b14a-6c3e-4a22-83d5-6cbddeba488a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:22.089719 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8b14a-6c3e-4a22-83d5-6cbddeba488a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:22.089992 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8b14a-6c3e-4a22-83d5-6cbddeba488a admin admin] PATH_INFO: `/v3/users/43ed20d6065e487db138de584bf8e704` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:22.091194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8b14a-6c3e-4a22-83d5-6cbddeba488a admin admin] RBAC: Authorizing `identity:get_user(user_id=43ed20d6065e487db138de584bf8e704)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:22.093901 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8b14a-6c3e-4a22-83d5-6cbddeba488a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:22.095460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 605/1188] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:58:22 2021] GET /identity/v3/users/43ed20d6065e487db138de584bf8e704 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:22.101200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6502c1d-3214-46ec-bdbd-3c57857f5a75 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:22.111486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6502c1d-3214-46ec-bdbd-3c57857f5a75 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:22.115945 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587fc90-bf42-4142-95f0-5c77fded3653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:22.116775 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587fc90-bf42-4142-95f0-5c77fded3653 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:22.117055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587fc90-bf42-4142-95f0-5c77fded3653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:22.117427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587fc90-bf42-4142-95f0-5c77fded3653 admin admin] PATH_INFO: `/v3/projects/7eca44daee0d43b39fda2560d17846cf` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:22.118638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587fc90-bf42-4142-95f0-5c77fded3653 admin admin] RBAC: Authorizing `identity:get_project(project_id=7eca44daee0d43b39fda2560d17846cf)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:22.120639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587fc90-bf42-4142-95f0-5c77fded3653 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:22.122246 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 584/1189] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:58:22 2021] GET /identity/v3/projects/7eca44daee0d43b39fda2560d17846cf => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:22.128430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8b14a-6c3e-4a22-83d5-6cbddeba488a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:22.137965 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8b14a-6c3e-4a22-83d5-6cbddeba488a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:22.142304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c0c25-d195-44de-a492-0aa9e7d9cfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:22.143176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c0c25-d195-44de-a492-0aa9e7d9cfa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:22.143447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c0c25-d195-44de-a492-0aa9e7d9cfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:22.143713 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c0c25-d195-44de-a492-0aa9e7d9cfa1 admin admin] PATH_INFO: `/v3/projects/7eca44daee0d43b39fda2560d17846cf/users/43ed20d6065e487db138de584bf8e704/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:22.145637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c0c25-d195-44de-a492-0aa9e7d9cfa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eca44daee0d43b39fda2560d17846cf, user_id=43ed20d6065e487db138de584bf8e704, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:22.148284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c0c25-d195-44de-a492-0aa9e7d9cfa1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:22.165078 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 606/1190] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:58:22 2021] PUT /identity/v3/projects/7eca44daee0d43b39fda2560d17846cf/users/43ed20d6065e487db138de584bf8e704/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:58:24.483052 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff837e-10c1-4d5c-861f-973549a257aa None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:24.483583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff837e-10c1-4d5c-861f-973549a257aa None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:24.483583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff837e-10c1-4d5c-861f-973549a257aa None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:24.485625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 585/1191] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:58:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:58:24.491324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af809c78-a0ad-45d2-96f4-5786c2cad5cc None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:24.491723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af809c78-a0ad-45d2-96f4-5786c2cad5cc None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:24.491871 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af809c78-a0ad-45d2-96f4-5786c2cad5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:24.509528 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-af809c78-a0ad-45d2-96f4-5786c2cad5cc None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:58:24.510838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-af809c78-a0ad-45d2-96f4-5786c2cad5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:58:24.565924 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 607/1192] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:58:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:58:24.590652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff837e-10c1-4d5c-861f-973549a257aa None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:24.602610 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff837e-10c1-4d5c-861f-973549a257aa None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:24.607439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a1c25-67a8-40b6-8bd4-7ea7403eb0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:24.608402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a1c25-67a8-40b6-8bd4-7ea7403eb0bc admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:24.608683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a1c25-67a8-40b6-8bd4-7ea7403eb0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:24.608957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a1c25-67a8-40b6-8bd4-7ea7403eb0bc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:24.619014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a1c25-67a8-40b6-8bd4-7ea7403eb0bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:58:24.626533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-679a1c25-67a8-40b6-8bd4-7ea7403eb0bc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:58:24.627659 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 586/1193] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:58:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:58:24.633746 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af809c78-a0ad-45d2-96f4-5786c2cad5cc None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:24.642453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af809c78-a0ad-45d2-96f4-5786c2cad5cc None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:24.646833 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003b5ce-0a64-47d6-b883-7a2678fcf5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:24.647466 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003b5ce-0a64-47d6-b883-7a2678fcf5cc admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:24.647744 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003b5ce-0a64-47d6-b883-7a2678fcf5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:24.648015 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003b5ce-0a64-47d6-b883-7a2678fcf5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:24.648786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003b5ce-0a64-47d6-b883-7a2678fcf5cc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:58:24.649086 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003b5ce-0a64-47d6-b883-7a2678fcf5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:24.650682 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003b5ce-0a64-47d6-b883-7a2678fcf5cc admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:24.658677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 608/1194] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:58:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:24.664622 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a1c25-67a8-40b6-8bd4-7ea7403eb0bc admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:24.675252 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a1c25-67a8-40b6-8bd4-7ea7403eb0bc admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:24.679739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88132f74-c545-4316-98ad-3ae843dfd0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:24.680557 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88132f74-c545-4316-98ad-3ae843dfd0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:24.680838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88132f74-c545-4316-98ad-3ae843dfd0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:24.681109 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88132f74-c545-4316-98ad-3ae843dfd0b1 admin admin] PATH_INFO: `/v3/users/43ed20d6065e487db138de584bf8e704` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:24.682296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88132f74-c545-4316-98ad-3ae843dfd0b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=43ed20d6065e487db138de584bf8e704)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:24.684419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88132f74-c545-4316-98ad-3ae843dfd0b1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:24.686763 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 587/1195] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Dec 9 00:58:24 2021] GET /identity/v3/users/43ed20d6065e487db138de584bf8e704 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:24.692447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003b5ce-0a64-47d6-b883-7a2678fcf5cc admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:24.701844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003b5ce-0a64-47d6-b883-7a2678fcf5cc admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:24.706422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba44db5-8a1f-48de-aa5c-acf5383bd987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:24.707029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba44db5-8a1f-48de-aa5c-acf5383bd987 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:24.707305 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba44db5-8a1f-48de-aa5c-acf5383bd987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:24.707578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba44db5-8a1f-48de-aa5c-acf5383bd987 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:24.715101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba44db5-8a1f-48de-aa5c-acf5383bd987 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:24.716857 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba44db5-8a1f-48de-aa5c-acf5383bd987 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:24.725546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 609/1196] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:58:24 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:58:24.731623 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88132f74-c545-4316-98ad-3ae843dfd0b1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:24.741940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88132f74-c545-4316-98ad-3ae843dfd0b1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:24.746269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17762077-8b4d-4f7a-a803-7b07349fe824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:24.747106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17762077-8b4d-4f7a-a803-7b07349fe824 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:24.747387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17762077-8b4d-4f7a-a803-7b07349fe824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:24.748377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17762077-8b4d-4f7a-a803-7b07349fe824 admin admin] PATH_INFO: `/v3/projects/7eca44daee0d43b39fda2560d17846cf` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:24.749816 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17762077-8b4d-4f7a-a803-7b07349fe824 admin admin] RBAC: Authorizing `identity:get_project(project_id=7eca44daee0d43b39fda2560d17846cf)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:24.751841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17762077-8b4d-4f7a-a803-7b07349fe824 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:24.753447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 588/1197] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 00:58:24 2021] GET /identity/v3/projects/7eca44daee0d43b39fda2560d17846cf => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:58:24.760200 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba44db5-8a1f-48de-aa5c-acf5383bd987 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:58:24.769065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba44db5-8a1f-48de-aa5c-acf5383bd987 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:58:24.773537 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d0c68-be08-49b7-9757-05560869db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:58:24.774154 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d0c68-be08-49b7-9757-05560869db06 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:58:24.774476 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d0c68-be08-49b7-9757-05560869db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:58:24.774753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d0c68-be08-49b7-9757-05560869db06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:58:24.775600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d0c68-be08-49b7-9757-05560869db06 admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=7eca44daee0d43b39fda2560d17846cf, user.id=43ed20d6065e487db138de584bf8e704) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:58:24.775908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d0c68-be08-49b7-9757-05560869db06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:58:24.777706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d0c68-be08-49b7-9757-05560869db06 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:58:24.783560 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 610/1198] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:58:24 2021] GET /identity/v3/role_assignments?user.id=43ed20d6065e487db138de584bf8e704&scope.project.id=7eca44daee0d43b39fda2560d17846cf&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:23.368380 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e712a-b284-44a8-8b4b-9ea410e409e1 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:23.369013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e712a-b284-44a8-8b4b-9ea410e409e1 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:23.369013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e712a-b284-44a8-8b4b-9ea410e409e1 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:23.371355 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 589/1199] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:59:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:59:23.379253 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70108914-b2c1-46c1-84d6-6d8b3fc1627b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:23.379253 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70108914-b2c1-46c1-84d6-6d8b3fc1627b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:23.379253 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70108914-b2c1-46c1-84d6-6d8b3fc1627b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:23.398224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-70108914-b2c1-46c1-84d6-6d8b3fc1627b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:59:23.399662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-70108914-b2c1-46c1-84d6-6d8b3fc1627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:59:23.409499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 611/1200] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:59:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:59:23.436505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e712a-b284-44a8-8b4b-9ea410e409e1 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:23.455608 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e712a-b284-44a8-8b4b-9ea410e409e1 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:23.461806 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e02321-a349-4306-86b5-07d55e4dde30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:23.463337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e02321-a349-4306-86b5-07d55e4dde30 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:23.464110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e02321-a349-4306-86b5-07d55e4dde30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:23.464808 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e02321-a349-4306-86b5-07d55e4dde30 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:23.480512 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e02321-a349-4306-86b5-07d55e4dde30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:23.482703 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e02321-a349-4306-86b5-07d55e4dde30 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:23.504530 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-d2e02321-a349-4306-86b5-07d55e4dde30 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:23.514140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70108914-b2c1-46c1-84d6-6d8b3fc1627b None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:23.518451 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 590/1201] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:23.523570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70108914-b2c1-46c1-84d6-6d8b3fc1627b None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:23.529176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3b53d-ba67-4120-ab70-f71d4b95179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:23.529919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3b53d-ba67-4120-ab70-f71d4b95179b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:23.530277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3b53d-ba67-4120-ab70-f71d4b95179b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:23.530651 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3b53d-ba67-4120-ab70-f71d4b95179b admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:23.531461 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3b53d-ba67-4120-ab70-f71d4b95179b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:23.531850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3b53d-ba67-4120-ab70-f71d4b95179b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:23.534422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3b53d-ba67-4120-ab70-f71d4b95179b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:23.546786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 612/1202] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:23.553915 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e02321-a349-4306-86b5-07d55e4dde30 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:23.579636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e02321-a349-4306-86b5-07d55e4dde30 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:23.588303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd018ca-0505-44e7-886f-a4f605704543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:23.589166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd018ca-0505-44e7-886f-a4f605704543 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:23.589649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd018ca-0505-44e7-886f-a4f605704543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:23.590122 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd018ca-0505-44e7-886f-a4f605704543 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:23.591212 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd018ca-0505-44e7-886f-a4f605704543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:23.593944 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd018ca-0505-44e7-886f-a4f605704543 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:23.623297 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 591/1203] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Dec 9 00:59:23 2021] POST /identity/v3/users => generated 251 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:59:26.315756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba933394-87f4-4c39-b458-8ad117633c96 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.316368 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba933394-87f4-4c39-b458-8ad117633c96 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.316368 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba933394-87f4-4c39-b458-8ad117633c96 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.318237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 613/1204] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:59:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:59:26.325004 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3024-fc11-45f6-833f-051883d16d20 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.325509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3024-fc11-45f6-833f-051883d16d20 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.325509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3024-fc11-45f6-833f-051883d16d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.343955 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-46db3024-fc11-45f6-833f-051883d16d20 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:59:26.345158 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-46db3024-fc11-45f6-833f-051883d16d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:59:26.353805 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 592/1205] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:59:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:59:26.380105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba933394-87f4-4c39-b458-8ad117633c96 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:26.394410 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba933394-87f4-4c39-b458-8ad117633c96 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:26.398840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d40d20-c013-4ac7-b704-f5581d1d1b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:26.399620 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d40d20-c013-4ac7-b704-f5581d1d1b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.399897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d40d20-c013-4ac7-b704-f5581d1d1b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.400172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d40d20-c013-4ac7-b704-f5581d1d1b73 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.412832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d40d20-c013-4ac7-b704-f5581d1d1b73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:59:26.420632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-a9d40d20-c013-4ac7-b704-f5581d1d1b73 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:59:26.421984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 614/1206] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:59:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:26.428398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db3024-fc11-45f6-833f-051883d16d20 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:26.440942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db3024-fc11-45f6-833f-051883d16d20 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:26.445853 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89d6fa-fe92-4d4a-97af-d10271884883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:26.446546 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89d6fa-fe92-4d4a-97af-d10271884883 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.447593 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89d6fa-fe92-4d4a-97af-d10271884883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.447593 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89d6fa-fe92-4d4a-97af-d10271884883 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.447874 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89d6fa-fe92-4d4a-97af-d10271884883 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:26.448223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89d6fa-fe92-4d4a-97af-d10271884883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:26.450397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89d6fa-fe92-4d4a-97af-d10271884883 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:26.460765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 593/1207] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:59:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:59:26.468408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d40d20-c013-4ac7-b704-f5581d1d1b73 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:26.482215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d40d20-c013-4ac7-b704-f5581d1d1b73 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:26.487486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b4b70-53f5-4022-ab0c-c8ed80e12449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:26.488287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b4b70-53f5-4022-ab0c-c8ed80e12449 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.488547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b4b70-53f5-4022-ab0c-c8ed80e12449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.488853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b4b70-53f5-4022-ab0c-c8ed80e12449 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.500845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b4b70-53f5-4022-ab0c-c8ed80e12449 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:26.502698 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b4b70-53f5-4022-ab0c-c8ed80e12449 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:26.520895 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-720b4b70-53f5-4022-ab0c-c8ed80e12449 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:26.522109 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 615/1208] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:26.529812 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89d6fa-fe92-4d4a-97af-d10271884883 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:26.540002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89d6fa-fe92-4d4a-97af-d10271884883 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:26.545916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb93da-cb89-47f9-ba50-1f06d252cb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:26.546626 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb93da-cb89-47f9-ba50-1f06d252cb2a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.546904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb93da-cb89-47f9-ba50-1f06d252cb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.547283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb93da-cb89-47f9-ba50-1f06d252cb2a admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.548019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb93da-cb89-47f9-ba50-1f06d252cb2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:26.548325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb93da-cb89-47f9-ba50-1f06d252cb2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:26.549963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb93da-cb89-47f9-ba50-1f06d252cb2a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:26.564537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 594/1209] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:26.573091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b4b70-53f5-4022-ab0c-c8ed80e12449 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:26.583707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b4b70-53f5-4022-ab0c-c8ed80e12449 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:26.589436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bd0ba-0ea4-4592-891e-43bc4af0b8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:26.590936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bd0ba-0ea4-4592-891e-43bc4af0b8dc admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.591940 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bd0ba-0ea4-4592-891e-43bc4af0b8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.591940 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bd0ba-0ea4-4592-891e-43bc4af0b8dc admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.599667 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bd0ba-0ea4-4592-891e-43bc4af0b8dc admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:26.601795 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bd0ba-0ea4-4592-891e-43bc4af0b8dc admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:26.619248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-e48bd0ba-0ea4-4592-891e-43bc4af0b8dc admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 09 00:59:26.620634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 616/1210] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:26 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:26.628571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb93da-cb89-47f9-ba50-1f06d252cb2a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:26.640579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb93da-cb89-47f9-ba50-1f06d252cb2a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:26.645770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987540f5-a3f5-4f6d-9f92-ffa1177978b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:26.646489 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987540f5-a3f5-4f6d-9f92-ffa1177978b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.646777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987540f5-a3f5-4f6d-9f92-ffa1177978b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.647054 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987540f5-a3f5-4f6d-9f92-ffa1177978b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.647901 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987540f5-a3f5-4f6d-9f92-ffa1177978b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:26.648204 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987540f5-a3f5-4f6d-9f92-ffa1177978b5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:26.650089 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987540f5-a3f5-4f6d-9f92-ffa1177978b5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:26.675144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 595/1211] 10.222.0.23 () {56 vars in 1164 bytes} [Thu Dec 9 00:59:26 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:26.682280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bd0ba-0ea4-4592-891e-43bc4af0b8dc admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:26.693594 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bd0ba-0ea4-4592-891e-43bc4af0b8dc admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:26.699359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f0185-9677-4187-9d1e-ec63211c4a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:26.700097 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f0185-9677-4187-9d1e-ec63211c4a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.700416 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f0185-9677-4187-9d1e-ec63211c4a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.700746 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f0185-9677-4187-9d1e-ec63211c4a47 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.709782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f0185-9677-4187-9d1e-ec63211c4a47 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:26.711752 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f0185-9677-4187-9d1e-ec63211c4a47 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:26.724127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 617/1212] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:59:26 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:59:26.731645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987540f5-a3f5-4f6d-9f92-ffa1177978b5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:26.743018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987540f5-a3f5-4f6d-9f92-ffa1177978b5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:26.747975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154376f5-4e5a-4832-8106-db4b6529edb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:26.748950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154376f5-4e5a-4832-8106-db4b6529edb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.749228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154376f5-4e5a-4832-8106-db4b6529edb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.749499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154376f5-4e5a-4832-8106-db4b6529edb3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.761244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154376f5-4e5a-4832-8106-db4b6529edb3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:26.763181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154376f5-4e5a-4832-8106-db4b6529edb3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:26.781586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-154376f5-4e5a-4832-8106-db4b6529edb3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:26.782800 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 596/1213] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:26.791696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f0185-9677-4187-9d1e-ec63211c4a47 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:26.801526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f0185-9677-4187-9d1e-ec63211c4a47 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:26.806841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b59d55-5156-4a50-8378-44756c7c8f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:26.807541 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b59d55-5156-4a50-8378-44756c7c8f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.807821 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b59d55-5156-4a50-8378-44756c7c8f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.808119 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b59d55-5156-4a50-8378-44756c7c8f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.808864 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b59d55-5156-4a50-8378-44756c7c8f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:26.809167 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b59d55-5156-4a50-8378-44756c7c8f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:26.810846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b59d55-5156-4a50-8378-44756c7c8f73 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:26.823864 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 618/1214] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:26.831452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154376f5-4e5a-4832-8106-db4b6529edb3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:26.842918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154376f5-4e5a-4832-8106-db4b6529edb3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:26.849870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed7638-8a80-41ed-af1b-8c0543e6094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:26.850644 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed7638-8a80-41ed-af1b-8c0543e6094b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.850919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed7638-8a80-41ed-af1b-8c0543e6094b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.851238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed7638-8a80-41ed-af1b-8c0543e6094b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.860391 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed7638-8a80-41ed-af1b-8c0543e6094b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:26.862803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed7638-8a80-41ed-af1b-8c0543e6094b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:26.877248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-6fed7638-8a80-41ed-af1b-8c0543e6094b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:59:26.878744 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 597/1215] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:59:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:59:26.885051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b59d55-5156-4a50-8378-44756c7c8f73 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:26.895779 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b59d55-5156-4a50-8378-44756c7c8f73 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:26.901281 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cffdb-4068-458f-837f-84a8933ff26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:26.902210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cffdb-4068-458f-837f-84a8933ff26b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.902717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cffdb-4068-458f-837f-84a8933ff26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.903259 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cffdb-4068-458f-837f-84a8933ff26b admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.904422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cffdb-4068-458f-837f-84a8933ff26b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:26.904910 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cffdb-4068-458f-837f-84a8933ff26b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:26.907244 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cffdb-4068-458f-837f-84a8933ff26b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:26.923027 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 619/1216] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:59:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:59:26.930999 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed7638-8a80-41ed-af1b-8c0543e6094b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:26.943474 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed7638-8a80-41ed-af1b-8c0543e6094b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:26.951391 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590746d-a4a5-4693-bae9-1073d8ccd09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:26.952151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590746d-a4a5-4693-bae9-1073d8ccd09e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:26.952513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590746d-a4a5-4693-bae9-1073d8ccd09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:26.952790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590746d-a4a5-4693-bae9-1073d8ccd09e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:26.954041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590746d-a4a5-4693-bae9-1073d8ccd09e admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=a2cebb33ff7c4e40a06b3c7f1a40823d) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:26.954470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590746d-a4a5-4693-bae9-1073d8ccd09e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:26.956548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590746d-a4a5-4693-bae9-1073d8ccd09e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:26.963409 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 598/1217] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:59:26 2021] GET /identity/v3/role_assignments?user.id=a2cebb33ff7c4e40a06b3c7f1a40823d&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:29.431619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbc970-39e0-4c9f-aa86-07e2b41041ef None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.432225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbc970-39e0-4c9f-aa86-07e2b41041ef None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.432225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbc970-39e0-4c9f-aa86-07e2b41041ef None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:29.434459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 620/1218] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:59:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:59:29.440571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1158de9-0b75-4ad6-8a37-47f97d5ed6d0 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.441024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1158de9-0b75-4ad6-8a37-47f97d5ed6d0 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.441128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1158de9-0b75-4ad6-8a37-47f97d5ed6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:29.459681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d1158de9-0b75-4ad6-8a37-47f97d5ed6d0 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:59:29.460890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d1158de9-0b75-4ad6-8a37-47f97d5ed6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:59:29.470193 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 599/1219] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:59:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:59:29.494600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbc970-39e0-4c9f-aa86-07e2b41041ef None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:29.507379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbc970-39e0-4c9f-aa86-07e2b41041ef None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:29.511891 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fcf89-fee9-44e7-b94a-29717d89e4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:29.512733 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fcf89-fee9-44e7-b94a-29717d89e4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.513048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fcf89-fee9-44e7-b94a-29717d89e4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.513355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fcf89-fee9-44e7-b94a-29717d89e4a0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:29.523847 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fcf89-fee9-44e7-b94a-29717d89e4a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:59:29.531367 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-a07fcf89-fee9-44e7-b94a-29717d89e4a0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:59:29.532619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 621/1220] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:59:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:29.540314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1158de9-0b75-4ad6-8a37-47f97d5ed6d0 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:29.550265 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1158de9-0b75-4ad6-8a37-47f97d5ed6d0 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:29.555167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d293a3-e734-4506-87f4-339162324af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:29.555794 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d293a3-e734-4506-87f4-339162324af9 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.556076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d293a3-e734-4506-87f4-339162324af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.556352 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d293a3-e734-4506-87f4-339162324af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:29.557107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d293a3-e734-4506-87f4-339162324af9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:29.557459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d293a3-e734-4506-87f4-339162324af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:29.559314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d293a3-e734-4506-87f4-339162324af9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:29.567938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 600/1221] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:59:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:29.574157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fcf89-fee9-44e7-b94a-29717d89e4a0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:29.586034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fcf89-fee9-44e7-b94a-29717d89e4a0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:29.591758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293296c-326a-4bc1-b6b7-3471df3b1aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:29.592539 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293296c-326a-4bc1-b6b7-3471df3b1aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.592818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293296c-326a-4bc1-b6b7-3471df3b1aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.593120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293296c-326a-4bc1-b6b7-3471df3b1aa2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:29.603860 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293296c-326a-4bc1-b6b7-3471df3b1aa2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:29.606337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293296c-326a-4bc1-b6b7-3471df3b1aa2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:29.625863 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-5293296c-326a-4bc1-b6b7-3471df3b1aa2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:29.627229 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 622/1222] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:29.633516 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d293a3-e734-4506-87f4-339162324af9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:29.643906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d293a3-e734-4506-87f4-339162324af9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:29.648652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf81d04-36b8-41ed-ba61-1257e3814801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:29.649289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf81d04-36b8-41ed-ba61-1257e3814801 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.649567 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf81d04-36b8-41ed-ba61-1257e3814801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.649838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf81d04-36b8-41ed-ba61-1257e3814801 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:29.650624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf81d04-36b8-41ed-ba61-1257e3814801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:29.650922 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf81d04-36b8-41ed-ba61-1257e3814801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:29.653230 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf81d04-36b8-41ed-ba61-1257e3814801 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:29.665172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 601/1223] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:29.672064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293296c-326a-4bc1-b6b7-3471df3b1aa2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:29.682158 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293296c-326a-4bc1-b6b7-3471df3b1aa2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:29.687312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588300b2-8f4d-49a9-86e2-00c7ac5ecb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:29.688260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588300b2-8f4d-49a9-86e2-00c7ac5ecb79 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.688543 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588300b2-8f4d-49a9-86e2-00c7ac5ecb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.688820 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588300b2-8f4d-49a9-86e2-00c7ac5ecb79 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:29.696280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588300b2-8f4d-49a9-86e2-00c7ac5ecb79 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:29.699005 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588300b2-8f4d-49a9-86e2-00c7ac5ecb79 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:29.715766 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-588300b2-8f4d-49a9-86e2-00c7ac5ecb79 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 09 00:59:29.717105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 623/1224] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:29 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:59:29.723735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf81d04-36b8-41ed-ba61-1257e3814801 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:29.734661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf81d04-36b8-41ed-ba61-1257e3814801 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:29.739930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73bfad-bc82-477b-80a3-ee920789bb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:29.741029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73bfad-bc82-477b-80a3-ee920789bb1f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.741362 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73bfad-bc82-477b-80a3-ee920789bb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.741619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73bfad-bc82-477b-80a3-ee920789bb1f admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:29.742593 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73bfad-bc82-477b-80a3-ee920789bb1f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:29.742906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73bfad-bc82-477b-80a3-ee920789bb1f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:29.744952 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73bfad-bc82-477b-80a3-ee920789bb1f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:29.764581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 602/1225] 10.222.0.23 () {56 vars in 1164 bytes} [Thu Dec 9 00:59:29 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:29.770722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588300b2-8f4d-49a9-86e2-00c7ac5ecb79 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:29.783180 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588300b2-8f4d-49a9-86e2-00c7ac5ecb79 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:29.788074 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa7859-d55b-467b-81c4-7186fbcc6769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:29.788884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7859-d55b-467b-81c4-7186fbcc6769 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.789202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7859-d55b-467b-81c4-7186fbcc6769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.789500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7859-d55b-467b-81c4-7186fbcc6769 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:29.801758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa7859-d55b-467b-81c4-7186fbcc6769 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:29.803907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa7859-d55b-467b-81c4-7186fbcc6769 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:29.824129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-b0fa7859-d55b-467b-81c4-7186fbcc6769 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:29.825409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 624/1226] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:29.832089 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73bfad-bc82-477b-80a3-ee920789bb1f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:29.843524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73bfad-bc82-477b-80a3-ee920789bb1f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:29.848829 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32459701-5b9c-40cc-9321-3b2b27f39535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:29.849982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32459701-5b9c-40cc-9321-3b2b27f39535 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.849982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32459701-5b9c-40cc-9321-3b2b27f39535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.850209 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32459701-5b9c-40cc-9321-3b2b27f39535 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:29.851031 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32459701-5b9c-40cc-9321-3b2b27f39535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:29.851343 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32459701-5b9c-40cc-9321-3b2b27f39535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:29.853770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32459701-5b9c-40cc-9321-3b2b27f39535 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:29.867264 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 603/1227] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:29.873510 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa7859-d55b-467b-81c4-7186fbcc6769 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:29.884020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa7859-d55b-467b-81c4-7186fbcc6769 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:29.890160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a79bd6-16b5-42d5-bfaf-1247c40a0d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:29.891024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a79bd6-16b5-42d5-bfaf-1247c40a0d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.891433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a79bd6-16b5-42d5-bfaf-1247c40a0d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.891707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a79bd6-16b5-42d5-bfaf-1247c40a0d81 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:29.899327 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a79bd6-16b5-42d5-bfaf-1247c40a0d81 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:29.901464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a79bd6-16b5-42d5-bfaf-1247c40a0d81 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:29.914978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-64a79bd6-16b5-42d5-bfaf-1247c40a0d81 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:59:29.916149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 625/1228] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:59:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:29.923168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32459701-5b9c-40cc-9321-3b2b27f39535 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:29.933326 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32459701-5b9c-40cc-9321-3b2b27f39535 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:29.937924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbda7c3-cac9-48da-98a3-86743e440153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:29.938590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbda7c3-cac9-48da-98a3-86743e440153 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.938871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbda7c3-cac9-48da-98a3-86743e440153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.939142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbda7c3-cac9-48da-98a3-86743e440153 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:29.939985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbda7c3-cac9-48da-98a3-86743e440153 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:29.940345 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbda7c3-cac9-48da-98a3-86743e440153 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:29.942626 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbda7c3-cac9-48da-98a3-86743e440153 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:29.958767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 604/1229] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:59:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:29.966088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a79bd6-16b5-42d5-bfaf-1247c40a0d81 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:29.978087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a79bd6-16b5-42d5-bfaf-1247c40a0d81 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:29.984220 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e34eb-b072-4813-bd69-00c8f7cb27a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:29.985116 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e34eb-b072-4813-bd69-00c8f7cb27a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:29.985384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e34eb-b072-4813-bd69-00c8f7cb27a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:29.985657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e34eb-b072-4813-bd69-00c8f7cb27a9 admin admin] PATH_INFO: `/v3/projects/0566d367619740a48d8dca2def78a386/users/a2cebb33ff7c4e40a06b3c7f1a40823d/roles/0de5bfc441494559af3a8cdd798c347e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:30.000436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e34eb-b072-4813-bd69-00c8f7cb27a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566d367619740a48d8dca2def78a386, user_id=a2cebb33ff7c4e40a06b3c7f1a40823d, role_id=0de5bfc441494559af3a8cdd798c347e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:30.003112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e34eb-b072-4813-bd69-00c8f7cb27a9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:30.017060 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 626/1230] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:59:29 2021] PUT /identity/v3/projects/0566d367619740a48d8dca2def78a386/users/a2cebb33ff7c4e40a06b3c7f1a40823d/roles/0de5bfc441494559af3a8cdd798c347e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:59:32.514646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a7daf-b01e-400c-b90c-bcec858cd1be None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:32.515269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a7daf-b01e-400c-b90c-bcec858cd1be None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:32.515269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a7daf-b01e-400c-b90c-bcec858cd1be None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:32.516951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 605/1231] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:59:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:59:32.523088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430f9e2-3486-4b68-83e2-eb105f4fc023 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:32.523523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430f9e2-3486-4b68-83e2-eb105f4fc023 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:32.523699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430f9e2-3486-4b68-83e2-eb105f4fc023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:32.543986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-0430f9e2-3486-4b68-83e2-eb105f4fc023 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:59:32.545312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0430f9e2-3486-4b68-83e2-eb105f4fc023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:59:32.608651 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 627/1232] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:59:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 00:59:32.634387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a7daf-b01e-400c-b90c-bcec858cd1be None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:32.647727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a7daf-b01e-400c-b90c-bcec858cd1be None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:32.652871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac080198-01e9-4dae-883e-8fb6d6dcf7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:32.653598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac080198-01e9-4dae-883e-8fb6d6dcf7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:32.653876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac080198-01e9-4dae-883e-8fb6d6dcf7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:32.654139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac080198-01e9-4dae-883e-8fb6d6dcf7ac admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:32.664248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac080198-01e9-4dae-883e-8fb6d6dcf7ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:59:32.671078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-ac080198-01e9-4dae-883e-8fb6d6dcf7ac admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 09 00:59:32.672233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 606/1233] 10.222.0.23 () {56 vars in 1123 bytes} [Thu Dec 9 00:59:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:32.678666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430f9e2-3486-4b68-83e2-eb105f4fc023 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:32.688457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430f9e2-3486-4b68-83e2-eb105f4fc023 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:32.692998 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17fed5-8039-4bdf-95f2-6dc55ef1f264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:32.693653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17fed5-8039-4bdf-95f2-6dc55ef1f264 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:32.693935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17fed5-8039-4bdf-95f2-6dc55ef1f264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:32.694213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17fed5-8039-4bdf-95f2-6dc55ef1f264 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:32.695006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17fed5-8039-4bdf-95f2-6dc55ef1f264 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:32.695315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17fed5-8039-4bdf-95f2-6dc55ef1f264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:32.696911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17fed5-8039-4bdf-95f2-6dc55ef1f264 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:32.706197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 628/1234] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Dec 9 00:59:32 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:32.712877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac080198-01e9-4dae-883e-8fb6d6dcf7ac admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:32.723943 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac080198-01e9-4dae-883e-8fb6d6dcf7ac admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:32.729228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb844d2b-bd1f-49f1-bccf-8ed83698ae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:32.730206 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb844d2b-bd1f-49f1-bccf-8ed83698ae4c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:32.730532 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb844d2b-bd1f-49f1-bccf-8ed83698ae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:32.730812 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb844d2b-bd1f-49f1-bccf-8ed83698ae4c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:32.741879 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb844d2b-bd1f-49f1-bccf-8ed83698ae4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:32.743814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb844d2b-bd1f-49f1-bccf-8ed83698ae4c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:32.763638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-fb844d2b-bd1f-49f1-bccf-8ed83698ae4c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:32.768147 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 607/1235] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:32.772766 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17fed5-8039-4bdf-95f2-6dc55ef1f264 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:32.787105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17fed5-8039-4bdf-95f2-6dc55ef1f264 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:32.792848 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d23d42-7c3f-4e6e-9a9a-d5901405a50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:32.793655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23d42-7c3f-4e6e-9a9a-d5901405a50d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:32.793986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23d42-7c3f-4e6e-9a9a-d5901405a50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:32.794310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23d42-7c3f-4e6e-9a9a-d5901405a50d admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:32.795140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d23d42-7c3f-4e6e-9a9a-d5901405a50d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:32.795480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d23d42-7c3f-4e6e-9a9a-d5901405a50d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:32.797324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d23d42-7c3f-4e6e-9a9a-d5901405a50d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:32.810865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 629/1236] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:32.817230 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb844d2b-bd1f-49f1-bccf-8ed83698ae4c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:32.828313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb844d2b-bd1f-49f1-bccf-8ed83698ae4c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:32.832908 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89f0ba-cf02-4136-b35a-969367f0bd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:32.833682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89f0ba-cf02-4136-b35a-969367f0bd03 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:32.833966 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89f0ba-cf02-4136-b35a-969367f0bd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:32.834236 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89f0ba-cf02-4136-b35a-969367f0bd03 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:32.846083 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89f0ba-cf02-4136-b35a-969367f0bd03 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:32.848311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89f0ba-cf02-4136-b35a-969367f0bd03 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:32.863665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-fa89f0ba-cf02-4136-b35a-969367f0bd03 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 09 00:59:32.864829 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 608/1237] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:32 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:32.871427 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d23d42-7c3f-4e6e-9a9a-d5901405a50d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:32.881059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d23d42-7c3f-4e6e-9a9a-d5901405a50d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:32.886163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44664c-dfc8-4372-beca-0114db416abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:32.886856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44664c-dfc8-4372-beca-0114db416abd admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:32.887129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44664c-dfc8-4372-beca-0114db416abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:32.887396 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44664c-dfc8-4372-beca-0114db416abd admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:32.888238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44664c-dfc8-4372-beca-0114db416abd admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:32.888538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44664c-dfc8-4372-beca-0114db416abd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:32.890406 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44664c-dfc8-4372-beca-0114db416abd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:32.912324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 630/1238] 10.222.0.23 () {56 vars in 1164 bytes} [Thu Dec 9 00:59:32 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:32.917864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89f0ba-cf02-4136-b35a-969367f0bd03 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:32.928916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89f0ba-cf02-4136-b35a-969367f0bd03 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:32.934106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b65d3-4a30-450e-9fff-f018ee97397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:32.934784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b65d3-4a30-450e-9fff-f018ee97397a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:32.935056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b65d3-4a30-450e-9fff-f018ee97397a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:32.935332 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b65d3-4a30-450e-9fff-f018ee97397a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:32.944029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b65d3-4a30-450e-9fff-f018ee97397a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:32.946096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b65d3-4a30-450e-9fff-f018ee97397a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:32.957431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 609/1239] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:59:32 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:59:32.964765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44664c-dfc8-4372-beca-0114db416abd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:32.975392 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44664c-dfc8-4372-beca-0114db416abd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:32.981214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1d2b-9a48-459a-b419-e72c0a8dc6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:32.982051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1d2b-9a48-459a-b419-e72c0a8dc6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:32.982516 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1d2b-9a48-459a-b419-e72c0a8dc6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:32.982820 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1d2b-9a48-459a-b419-e72c0a8dc6a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:32.994526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa1d2b-9a48-459a-b419-e72c0a8dc6a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:32.997410 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa1d2b-9a48-459a-b419-e72c0a8dc6a6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:33.014315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-21fa1d2b-9a48-459a-b419-e72c0a8dc6a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:33.015399 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 631/1240] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:59:33.024693 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b65d3-4a30-450e-9fff-f018ee97397a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:33.033795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b65d3-4a30-450e-9fff-f018ee97397a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:33.038446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d129d29-23b7-4393-b521-57c3ed8cf997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:33.039087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d129d29-23b7-4393-b521-57c3ed8cf997 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:33.039362 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d129d29-23b7-4393-b521-57c3ed8cf997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:33.039632 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d129d29-23b7-4393-b521-57c3ed8cf997 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:33.040354 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d129d29-23b7-4393-b521-57c3ed8cf997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:33.040650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d129d29-23b7-4393-b521-57c3ed8cf997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:33.042937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d129d29-23b7-4393-b521-57c3ed8cf997 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:33.054096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 610/1241] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:33.061012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1d2b-9a48-459a-b419-e72c0a8dc6a6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:33.073852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1d2b-9a48-459a-b419-e72c0a8dc6a6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:33.079322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af64ad-dbdb-424a-9acf-b063a243ea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:33.080094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af64ad-dbdb-424a-9acf-b063a243ea63 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:33.080402 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af64ad-dbdb-424a-9acf-b063a243ea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:33.080675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af64ad-dbdb-424a-9acf-b063a243ea63 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:33.088173 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af64ad-dbdb-424a-9acf-b063a243ea63 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:33.090480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af64ad-dbdb-424a-9acf-b063a243ea63 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:33.106431 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-18af64ad-dbdb-424a-9acf-b063a243ea63 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:59:33.107633 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 632/1242] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:59:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:33.114345 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d129d29-23b7-4393-b521-57c3ed8cf997 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:33.125182 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d129d29-23b7-4393-b521-57c3ed8cf997 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:33.129702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c021fa4-7b48-445d-b10c-dda3954645de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:33.130420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c021fa4-7b48-445d-b10c-dda3954645de admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:33.130796 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c021fa4-7b48-445d-b10c-dda3954645de admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:33.131045 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c021fa4-7b48-445d-b10c-dda3954645de admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:33.131830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c021fa4-7b48-445d-b10c-dda3954645de admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:33.132280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c021fa4-7b48-445d-b10c-dda3954645de admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:33.134194 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c021fa4-7b48-445d-b10c-dda3954645de admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:33.147292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 611/1243] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:59:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:33.154897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af64ad-dbdb-424a-9acf-b063a243ea63 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:33.165490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af64ad-dbdb-424a-9acf-b063a243ea63 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:33.170880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebe8ff-e6d1-484c-9c13-baf315384407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:33.171500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebe8ff-e6d1-484c-9c13-baf315384407 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:33.171830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebe8ff-e6d1-484c-9c13-baf315384407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:33.172050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebe8ff-e6d1-484c-9c13-baf315384407 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:33.173024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebe8ff-e6d1-484c-9c13-baf315384407 admin admin] RBAC: Adding query filter params (role.id=0de5bfc441494559af3a8cdd798c347e, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=a2cebb33ff7c4e40a06b3c7f1a40823d) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:33.173322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebe8ff-e6d1-484c-9c13-baf315384407 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:33.175156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebe8ff-e6d1-484c-9c13-baf315384407 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:33.181087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 633/1244] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:59:33 2021] GET /identity/v3/role_assignments?user.id=a2cebb33ff7c4e40a06b3c7f1a40823d&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=0de5bfc441494559af3a8cdd798c347e => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:35.712200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8c2df-2cc1-4b14-8bd8-b390b0f5c006 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:35.712811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8c2df-2cc1-4b14-8bd8-b390b0f5c006 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:35.712811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8c2df-2cc1-4b14-8bd8-b390b0f5c006 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:35.715587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 612/1245] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:59:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 00:59:35.721468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ce82f-5deb-445c-90e9-723caa637030 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:35.721897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ce82f-5deb-445c-90e9-723caa637030 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:35.722002 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ce82f-5deb-445c-90e9-723caa637030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:35.740640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-f48ce82f-5deb-445c-90e9-723caa637030 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:59:35.741925 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f48ce82f-5deb-445c-90e9-723caa637030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:59:35.750820 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 634/1246] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:59:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:59:35.775312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8c2df-2cc1-4b14-8bd8-b390b0f5c006 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:35.788104 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8c2df-2cc1-4b14-8bd8-b390b0f5c006 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:35.793186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07269e12-0511-477f-b234-52400c578351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:35.793966 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07269e12-0511-477f-b234-52400c578351 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:35.794244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07269e12-0511-477f-b234-52400c578351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:35.794548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07269e12-0511-477f-b234-52400c578351 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:35.805400 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07269e12-0511-477f-b234-52400c578351 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:59:35.813271 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-07269e12-0511-477f-b234-52400c578351 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:59:35.820006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 613/1247] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:59:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:35.821251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ce82f-5deb-445c-90e9-723caa637030 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:35.831437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ce82f-5deb-445c-90e9-723caa637030 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:35.836429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe34d74-a2e9-413e-a9c6-b0617090053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:35.837198 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe34d74-a2e9-413e-a9c6-b0617090053d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:35.837558 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe34d74-a2e9-413e-a9c6-b0617090053d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:35.837906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe34d74-a2e9-413e-a9c6-b0617090053d admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:35.839526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe34d74-a2e9-413e-a9c6-b0617090053d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:35.840182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe34d74-a2e9-413e-a9c6-b0617090053d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:35.841837 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe34d74-a2e9-413e-a9c6-b0617090053d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:35.851009 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 635/1248] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:59:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:59:35.858197 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07269e12-0511-477f-b234-52400c578351 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:35.867954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07269e12-0511-477f-b234-52400c578351 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:35.872909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557768eb-6649-4e35-9d43-39be76362fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:35.873769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557768eb-6649-4e35-9d43-39be76362fbe admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:35.874126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557768eb-6649-4e35-9d43-39be76362fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:35.874503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557768eb-6649-4e35-9d43-39be76362fbe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:35.885056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557768eb-6649-4e35-9d43-39be76362fbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:35.887445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557768eb-6649-4e35-9d43-39be76362fbe admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:35.904367 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-557768eb-6649-4e35-9d43-39be76362fbe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:35.905571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 614/1249] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:35.911814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe34d74-a2e9-413e-a9c6-b0617090053d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:35.921913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe34d74-a2e9-413e-a9c6-b0617090053d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:35.926692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763093-a738-4952-8c4e-c3e83daccf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:35.927326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763093-a738-4952-8c4e-c3e83daccf4b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:35.927602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763093-a738-4952-8c4e-c3e83daccf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:35.927874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763093-a738-4952-8c4e-c3e83daccf4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:35.928592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2763093-a738-4952-8c4e-c3e83daccf4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:35.928892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2763093-a738-4952-8c4e-c3e83daccf4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:35.930481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2763093-a738-4952-8c4e-c3e83daccf4b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:35.949479 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 636/1250] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:35.950785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557768eb-6649-4e35-9d43-39be76362fbe admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:35.960381 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557768eb-6649-4e35-9d43-39be76362fbe admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:35.964959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10786de-fa4c-4910-b69d-14b529bbfa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:35.965664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10786de-fa4c-4910-b69d-14b529bbfa55 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:35.965942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10786de-fa4c-4910-b69d-14b529bbfa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:35.966214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10786de-fa4c-4910-b69d-14b529bbfa55 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:35.975383 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10786de-fa4c-4910-b69d-14b529bbfa55 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:35.977363 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10786de-fa4c-4910-b69d-14b529bbfa55 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:35.992317 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-b10786de-fa4c-4910-b69d-14b529bbfa55 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 09 00:59:35.993492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 615/1251] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:35 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:36.000356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763093-a738-4952-8c4e-c3e83daccf4b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:36.010903 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763093-a738-4952-8c4e-c3e83daccf4b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:36.016010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40a390-6826-4d87-9f02-aea70f6c544a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:36.016684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40a390-6826-4d87-9f02-aea70f6c544a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:36.016974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40a390-6826-4d87-9f02-aea70f6c544a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:36.017240 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40a390-6826-4d87-9f02-aea70f6c544a admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:36.018084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40a390-6826-4d87-9f02-aea70f6c544a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:36.018418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40a390-6826-4d87-9f02-aea70f6c544a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:36.020433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40a390-6826-4d87-9f02-aea70f6c544a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:36.042574 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 637/1252] 10.222.0.23 () {56 vars in 1164 bytes} [Thu Dec 9 00:59:35 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:36.048578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10786de-fa4c-4910-b69d-14b529bbfa55 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:36.059433 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10786de-fa4c-4910-b69d-14b529bbfa55 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:36.064069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4941b1-84dc-40f1-9d91-9a1873451503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:36.064696 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4941b1-84dc-40f1-9d91-9a1873451503 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:36.064979 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4941b1-84dc-40f1-9d91-9a1873451503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:36.065260 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4941b1-84dc-40f1-9d91-9a1873451503 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:36.073677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4941b1-84dc-40f1-9d91-9a1873451503 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:36.075446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4941b1-84dc-40f1-9d91-9a1873451503 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:36.085367 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 616/1253] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:59:36 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:59:36.092096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40a390-6826-4d87-9f02-aea70f6c544a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:36.103356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40a390-6826-4d87-9f02-aea70f6c544a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:36.109379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69c5b1-07a4-4fa4-bbea-cef8e592ecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:36.110326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69c5b1-07a4-4fa4-bbea-cef8e592ecf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:36.110702 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69c5b1-07a4-4fa4-bbea-cef8e592ecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:36.111083 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69c5b1-07a4-4fa4-bbea-cef8e592ecf1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:36.125030 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69c5b1-07a4-4fa4-bbea-cef8e592ecf1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:36.127168 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69c5b1-07a4-4fa4-bbea-cef8e592ecf1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:36.145919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-fe69c5b1-07a4-4fa4-bbea-cef8e592ecf1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:36.147412 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 638/1254] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:36.154774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4941b1-84dc-40f1-9d91-9a1873451503 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:36.163821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4941b1-84dc-40f1-9d91-9a1873451503 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:36.169451 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c85ce-7b77-4980-904f-d6d9d5424b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:36.170070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c85ce-7b77-4980-904f-d6d9d5424b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:36.170374 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c85ce-7b77-4980-904f-d6d9d5424b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:36.170662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c85ce-7b77-4980-904f-d6d9d5424b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:36.171390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c85ce-7b77-4980-904f-d6d9d5424b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:36.171692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c85ce-7b77-4980-904f-d6d9d5424b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:36.173269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c85ce-7b77-4980-904f-d6d9d5424b58 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:36.185725 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 617/1255] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:36.191907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69c5b1-07a4-4fa4-bbea-cef8e592ecf1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:36.202176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69c5b1-07a4-4fa4-bbea-cef8e592ecf1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:36.206728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548f001-ae6f-465e-9a7d-e389463d82a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:36.207500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f001-ae6f-465e-9a7d-e389463d82a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:36.207771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f001-ae6f-465e-9a7d-e389463d82a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:36.208048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f001-ae6f-465e-9a7d-e389463d82a6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:36.215843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548f001-ae6f-465e-9a7d-e389463d82a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:36.217723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548f001-ae6f-465e-9a7d-e389463d82a6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:36.231622 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-3548f001-ae6f-465e-9a7d-e389463d82a6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:59:36.232790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 639/1256] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:59:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:36.239574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c85ce-7b77-4980-904f-d6d9d5424b58 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:36.249750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c85ce-7b77-4980-904f-d6d9d5424b58 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:36.254604 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588745c2-d2d8-4e0b-8129-8c7f5c05c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:36.255310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588745c2-d2d8-4e0b-8129-8c7f5c05c22f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:36.255594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588745c2-d2d8-4e0b-8129-8c7f5c05c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:36.255877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588745c2-d2d8-4e0b-8129-8c7f5c05c22f admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:36.256675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588745c2-d2d8-4e0b-8129-8c7f5c05c22f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:36.256985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588745c2-d2d8-4e0b-8129-8c7f5c05c22f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:36.258992 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588745c2-d2d8-4e0b-8129-8c7f5c05c22f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:36.271424 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 618/1257] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:59:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:59:36.279026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548f001-ae6f-465e-9a7d-e389463d82a6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:36.289864 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548f001-ae6f-465e-9a7d-e389463d82a6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:36.296257 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c069340-c95d-4cb6-b76c-ecdeeaf520cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:36.296998 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c069340-c95d-4cb6-b76c-ecdeeaf520cf admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:36.297296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c069340-c95d-4cb6-b76c-ecdeeaf520cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:36.297575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c069340-c95d-4cb6-b76c-ecdeeaf520cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:36.298575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c069340-c95d-4cb6-b76c-ecdeeaf520cf admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=a2cebb33ff7c4e40a06b3c7f1a40823d) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:36.298883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c069340-c95d-4cb6-b76c-ecdeeaf520cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:36.300918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c069340-c95d-4cb6-b76c-ecdeeaf520cf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:36.307032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 640/1258] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:59:36 2021] GET /identity/v3/role_assignments?user.id=a2cebb33ff7c4e40a06b3c7f1a40823d&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 00:59:38.693006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a461c39-81fd-47ee-9905-082da9988a9e None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:38.693541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a461c39-81fd-47ee-9905-082da9988a9e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:38.693541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a461c39-81fd-47ee-9905-082da9988a9e None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:38.695467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 619/1259] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:59:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:59:38.702206 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045855-b738-4935-8e2b-d2aed7d8c155 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:38.702684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045855-b738-4935-8e2b-d2aed7d8c155 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:38.702831 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045855-b738-4935-8e2b-d2aed7d8c155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:38.720359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e2045855-b738-4935-8e2b-d2aed7d8c155 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:59:38.721584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e2045855-b738-4935-8e2b-d2aed7d8c155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:59:38.729850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 641/1260] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:59:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:59:38.754880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a461c39-81fd-47ee-9905-082da9988a9e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:38.767798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a461c39-81fd-47ee-9905-082da9988a9e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:38.772658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ffc0a-86e8-447d-b516-d5edad736d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:38.773448 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ffc0a-86e8-447d-b516-d5edad736d75 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:38.773769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ffc0a-86e8-447d-b516-d5edad736d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:38.774047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ffc0a-86e8-447d-b516-d5edad736d75 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:38.787361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ffc0a-86e8-447d-b516-d5edad736d75 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:59:38.796250 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-0a3ffc0a-86e8-447d-b516-d5edad736d75 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:59:38.797583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 620/1261] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:59:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:38.804164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2045855-b738-4935-8e2b-d2aed7d8c155 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:38.816182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2045855-b738-4935-8e2b-d2aed7d8c155 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:38.821302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c90169-41cb-42a7-ba74-72285c3255ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:38.821964 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c90169-41cb-42a7-ba74-72285c3255ac admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:38.822252 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c90169-41cb-42a7-ba74-72285c3255ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:38.823106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c90169-41cb-42a7-ba74-72285c3255ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:38.823990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c90169-41cb-42a7-ba74-72285c3255ac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:38.824411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c90169-41cb-42a7-ba74-72285c3255ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:38.826343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c90169-41cb-42a7-ba74-72285c3255ac admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:38.842409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 642/1262] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:59:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:38.844317 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ffc0a-86e8-447d-b516-d5edad736d75 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:38.856102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ffc0a-86e8-447d-b516-d5edad736d75 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:38.861468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cea85-1932-4536-95dd-ea89174bac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:38.862286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cea85-1932-4536-95dd-ea89174bac3b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:38.862651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cea85-1932-4536-95dd-ea89174bac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:38.863005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cea85-1932-4536-95dd-ea89174bac3b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:38.874452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cea85-1932-4536-95dd-ea89174bac3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:38.876539 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cea85-1932-4536-95dd-ea89174bac3b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:38.895888 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-9a7cea85-1932-4536-95dd-ea89174bac3b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:38.897774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 621/1263] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:38.905992 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c90169-41cb-42a7-ba74-72285c3255ac admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:38.916396 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c90169-41cb-42a7-ba74-72285c3255ac admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:38.921523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f1823-5bc3-4fc3-9daf-9a806e63a0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:38.922319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f1823-5bc3-4fc3-9daf-9a806e63a0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:38.922714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f1823-5bc3-4fc3-9daf-9a806e63a0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:38.923068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f1823-5bc3-4fc3-9daf-9a806e63a0b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:38.923880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f1823-5bc3-4fc3-9daf-9a806e63a0b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:38.924265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f1823-5bc3-4fc3-9daf-9a806e63a0b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:38.926005 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f1823-5bc3-4fc3-9daf-9a806e63a0b5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:38.940109 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 643/1264] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:38.948968 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cea85-1932-4536-95dd-ea89174bac3b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:38.960865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cea85-1932-4536-95dd-ea89174bac3b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:38.966948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6406e-611e-421d-8d99-249c07798743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:38.967735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6406e-611e-421d-8d99-249c07798743 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:38.968019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6406e-611e-421d-8d99-249c07798743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:38.968296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6406e-611e-421d-8d99-249c07798743 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:38.976990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6406e-611e-421d-8d99-249c07798743 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:38.980201 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6406e-611e-421d-8d99-249c07798743 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:38.997949 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-9ce6406e-611e-421d-8d99-249c07798743 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 09 00:59:39.006191 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 622/1265] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:38 2021] GET /identity/v3/users/placement => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:39.007353 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f1823-5bc3-4fc3-9daf-9a806e63a0b5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:39.017520 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f1823-5bc3-4fc3-9daf-9a806e63a0b5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:39.023083 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aee4b-30ff-48d4-bc72-a7d681e90679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:39.023799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aee4b-30ff-48d4-bc72-a7d681e90679 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:39.024113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aee4b-30ff-48d4-bc72-a7d681e90679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:39.024393 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aee4b-30ff-48d4-bc72-a7d681e90679 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:39.025314 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aee4b-30ff-48d4-bc72-a7d681e90679 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:39.025628 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aee4b-30ff-48d4-bc72-a7d681e90679 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:39.027897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aee4b-30ff-48d4-bc72-a7d681e90679 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:39.047743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 644/1266] 10.222.0.23 () {56 vars in 1164 bytes} [Thu Dec 9 00:59:39 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:39.053122 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6406e-611e-421d-8d99-249c07798743 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:39.063318 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6406e-611e-421d-8d99-249c07798743 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:39.067733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef4876-88b5-489e-aa58-054de8f09917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:39.068497 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef4876-88b5-489e-aa58-054de8f09917 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:39.068781 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef4876-88b5-489e-aa58-054de8f09917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:39.069056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef4876-88b5-489e-aa58-054de8f09917 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:39.079727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef4876-88b5-489e-aa58-054de8f09917 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:39.081746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef4876-88b5-489e-aa58-054de8f09917 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:39.099612 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-68ef4876-88b5-489e-aa58-054de8f09917 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:39.100750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 623/1267] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:39.107757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aee4b-30ff-48d4-bc72-a7d681e90679 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:39.118091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aee4b-30ff-48d4-bc72-a7d681e90679 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:39.123910 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210a895-c713-43b1-a88d-177447f5dfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:39.124804 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210a895-c713-43b1-a88d-177447f5dfbd admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:39.125070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210a895-c713-43b1-a88d-177447f5dfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:39.125342 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210a895-c713-43b1-a88d-177447f5dfbd admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:39.126282 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210a895-c713-43b1-a88d-177447f5dfbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:39.126662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210a895-c713-43b1-a88d-177447f5dfbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:39.128400 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210a895-c713-43b1-a88d-177447f5dfbd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:39.140797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 645/1268] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:39.147002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef4876-88b5-489e-aa58-054de8f09917 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:39.159127 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef4876-88b5-489e-aa58-054de8f09917 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:39.163854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ca3fb-bb68-47b7-8d0d-791f5726f45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:39.164639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ca3fb-bb68-47b7-8d0d-791f5726f45e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:39.164922 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ca3fb-bb68-47b7-8d0d-791f5726f45e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:39.165196 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ca3fb-bb68-47b7-8d0d-791f5726f45e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:39.172398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ca3fb-bb68-47b7-8d0d-791f5726f45e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:39.174341 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ca3fb-bb68-47b7-8d0d-791f5726f45e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:39.188077 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-598ca3fb-bb68-47b7-8d0d-791f5726f45e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:59:39.189191 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 624/1269] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:59:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:39.195806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210a895-c713-43b1-a88d-177447f5dfbd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:39.206604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210a895-c713-43b1-a88d-177447f5dfbd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:39.211098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017ac82-eac1-4805-95c4-dc9d8b6e6aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:39.211737 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017ac82-eac1-4805-95c4-dc9d8b6e6aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:39.212059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017ac82-eac1-4805-95c4-dc9d8b6e6aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:39.212338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017ac82-eac1-4805-95c4-dc9d8b6e6aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:39.213164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017ac82-eac1-4805-95c4-dc9d8b6e6aa2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:39.213587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017ac82-eac1-4805-95c4-dc9d8b6e6aa2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:39.215686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017ac82-eac1-4805-95c4-dc9d8b6e6aa2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:39.228167 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 646/1270] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:59:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:39.235196 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ca3fb-bb68-47b7-8d0d-791f5726f45e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:39.246166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ca3fb-bb68-47b7-8d0d-791f5726f45e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:39.250870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645373-e9f9-407f-81a2-fdae14546e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:39.251848 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645373-e9f9-407f-81a2-fdae14546e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:39.252139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645373-e9f9-407f-81a2-fdae14546e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:39.252427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645373-e9f9-407f-81a2-fdae14546e01 admin admin] PATH_INFO: `/v3/projects/0566d367619740a48d8dca2def78a386/users/a2cebb33ff7c4e40a06b3c7f1a40823d/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:39.254600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03645373-e9f9-407f-81a2-fdae14546e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566d367619740a48d8dca2def78a386, user_id=a2cebb33ff7c4e40a06b3c7f1a40823d, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:39.257489 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03645373-e9f9-407f-81a2-fdae14546e01 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:39.270399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 625/1271] 10.222.0.23 () {58 vars in 1460 bytes} [Thu Dec 9 00:59:39 2021] PUT /identity/v3/projects/0566d367619740a48d8dca2def78a386/users/a2cebb33ff7c4e40a06b3c7f1a40823d/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 00:59:41.675334 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0eb99c-86dd-4e45-869c-2ae8dc1f63d4 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:41.675868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0eb99c-86dd-4e45-869c-2ae8dc1f63d4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:41.675868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0eb99c-86dd-4e45-869c-2ae8dc1f63d4 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:41.677664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 647/1272] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:59:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:59:41.683437 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a681e0-3ea5-40ba-838a-697b1d1c21a9 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:41.683855 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a681e0-3ea5-40ba-838a-697b1d1c21a9 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:41.683970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a681e0-3ea5-40ba-838a-697b1d1c21a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:41.700779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-86a681e0-3ea5-40ba-838a-697b1d1c21a9 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:59:41.701969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-86a681e0-3ea5-40ba-838a-697b1d1c21a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:59:41.756953 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 626/1273] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:59:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:59:41.781676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0eb99c-86dd-4e45-869c-2ae8dc1f63d4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:41.794236 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0eb99c-86dd-4e45-869c-2ae8dc1f63d4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:41.798520 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f5ff7-ff69-4695-827f-cb3a2ca1ae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:41.799276 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5ff7-ff69-4695-827f-cb3a2ca1ae0d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:41.799549 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5ff7-ff69-4695-827f-cb3a2ca1ae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:41.799814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5ff7-ff69-4695-827f-cb3a2ca1ae0d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:41.809538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f5ff7-ff69-4695-827f-cb3a2ca1ae0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 09 00:59:41.816229 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-690f5ff7-ff69-4695-827f-cb3a2ca1ae0d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 09 00:59:41.817355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 648/1274] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Dec 9 00:59:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:41.823892 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a681e0-3ea5-40ba-838a-697b1d1c21a9 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:41.832491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a681e0-3ea5-40ba-838a-697b1d1c21a9 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:41.836942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b90875-6f4e-4457-847f-27f6e4204365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:41.837582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b90875-6f4e-4457-847f-27f6e4204365 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:41.837864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b90875-6f4e-4457-847f-27f6e4204365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:41.838866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b90875-6f4e-4457-847f-27f6e4204365 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:41.839686 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b90875-6f4e-4457-847f-27f6e4204365 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:41.840021 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b90875-6f4e-4457-847f-27f6e4204365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:41.841618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b90875-6f4e-4457-847f-27f6e4204365 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:41.849773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 627/1275] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Dec 9 00:59:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:41.856489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f5ff7-ff69-4695-827f-cb3a2ca1ae0d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:41.866737 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f5ff7-ff69-4695-827f-cb3a2ca1ae0d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:41.871523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b368d7-b104-42f5-9781-db2d60fd3dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:41.872277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b368d7-b104-42f5-9781-db2d60fd3dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:41.872557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b368d7-b104-42f5-9781-db2d60fd3dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:41.872830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b368d7-b104-42f5-9781-db2d60fd3dd2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:41.882634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b368d7-b104-42f5-9781-db2d60fd3dd2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:41.884469 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b368d7-b104-42f5-9781-db2d60fd3dd2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:41.901689 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-a7b368d7-b104-42f5-9781-db2d60fd3dd2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:41.902862 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 649/1276] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:41.908777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b90875-6f4e-4457-847f-27f6e4204365 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:41.918163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b90875-6f4e-4457-847f-27f6e4204365 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:41.922668 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0aebb-a62b-4834-9390-3f3f7e48f485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:41.923300 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0aebb-a62b-4834-9390-3f3f7e48f485 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:41.923581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0aebb-a62b-4834-9390-3f3f7e48f485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:41.923856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0aebb-a62b-4834-9390-3f3f7e48f485 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:41.924573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0aebb-a62b-4834-9390-3f3f7e48f485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:41.924878 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0aebb-a62b-4834-9390-3f3f7e48f485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:41.926529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0aebb-a62b-4834-9390-3f3f7e48f485 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:41.938792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 628/1277] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:41.944523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b368d7-b104-42f5-9781-db2d60fd3dd2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:41.954653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b368d7-b104-42f5-9781-db2d60fd3dd2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:41.959026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f77a-6f97-4ee7-9dd6-ac89f94c5a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:41.959783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f77a-6f97-4ee7-9dd6-ac89f94c5a69 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:41.960060 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f77a-6f97-4ee7-9dd6-ac89f94c5a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:41.960329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f77a-6f97-4ee7-9dd6-ac89f94c5a69 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:41.967878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7f77a-6f97-4ee7-9dd6-ac89f94c5a69 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:41.969852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7f77a-6f97-4ee7-9dd6-ac89f94c5a69 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:41.984597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-53a7f77a-6f97-4ee7-9dd6-ac89f94c5a69 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 09 00:59:41.985691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 650/1278] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:41 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:41.991570 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0aebb-a62b-4834-9390-3f3f7e48f485 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:42.000892 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0aebb-a62b-4834-9390-3f3f7e48f485 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:42.005301 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fe89e-7401-412b-b014-ee4071251536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:42.005933 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fe89e-7401-412b-b014-ee4071251536 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:42.006213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fe89e-7401-412b-b014-ee4071251536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:42.006530 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fe89e-7401-412b-b014-ee4071251536 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:42.007352 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fe89e-7401-412b-b014-ee4071251536 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:42.007658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fe89e-7401-412b-b014-ee4071251536 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:42.009444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fe89e-7401-412b-b014-ee4071251536 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:42.026899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 629/1279] 10.222.0.23 () {56 vars in 1164 bytes} [Thu Dec 9 00:59:41 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:42.032799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f77a-6f97-4ee7-9dd6-ac89f94c5a69 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:42.042379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f77a-6f97-4ee7-9dd6-ac89f94c5a69 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:42.046843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54868f97-5a1a-405b-84f7-9d793160fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:42.047456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54868f97-5a1a-405b-84f7-9d793160fcbd admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:42.047737 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54868f97-5a1a-405b-84f7-9d793160fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:42.048011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54868f97-5a1a-405b-84f7-9d793160fcbd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:42.055564 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54868f97-5a1a-405b-84f7-9d793160fcbd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:42.057317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54868f97-5a1a-405b-84f7-9d793160fcbd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:42.065973 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 651/1280] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Dec 9 00:59:42 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 00:59:42.071643 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fe89e-7401-412b-b014-ee4071251536 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:42.081668 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fe89e-7401-412b-b014-ee4071251536 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:42.086070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839d66e-cb80-4ee6-997c-bfb167e68173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:42.086856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839d66e-cb80-4ee6-997c-bfb167e68173 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:42.087139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839d66e-cb80-4ee6-997c-bfb167e68173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:42.087414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839d66e-cb80-4ee6-997c-bfb167e68173 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:42.098109 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839d66e-cb80-4ee6-997c-bfb167e68173 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:42.099925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839d66e-cb80-4ee6-997c-bfb167e68173 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:42.116389 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-2839d66e-cb80-4ee6-997c-bfb167e68173 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 09 00:59:42.117481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 630/1281] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Dec 9 00:59:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:42.123294 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54868f97-5a1a-405b-84f7-9d793160fcbd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:42.131767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54868f97-5a1a-405b-84f7-9d793160fcbd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:42.136817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bbdb7-d87e-4d96-806e-5c436c56c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:42.137436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bbdb7-d87e-4d96-806e-5c436c56c6ae admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:42.137718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bbdb7-d87e-4d96-806e-5c436c56c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:42.137993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bbdb7-d87e-4d96-806e-5c436c56c6ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:42.138741 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bbdb7-d87e-4d96-806e-5c436c56c6ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:42.139049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bbdb7-d87e-4d96-806e-5c436c56c6ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:42.140596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bbdb7-d87e-4d96-806e-5c436c56c6ae admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:42.151504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 652/1282] 10.222.0.23 () {56 vars in 1130 bytes} [Thu Dec 9 00:59:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:42.157016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839d66e-cb80-4ee6-997c-bfb167e68173 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:42.166328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839d66e-cb80-4ee6-997c-bfb167e68173 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:42.171098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ba275-966e-4767-9683-023450e71b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:42.171832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ba275-966e-4767-9683-023450e71b48 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:42.172110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ba275-966e-4767-9683-023450e71b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:42.172380 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ba275-966e-4767-9683-023450e71b48 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:42.179001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ba275-966e-4767-9683-023450e71b48 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:42.180831 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ba275-966e-4767-9683-023450e71b48 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:42.194192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING keystone.server.flask.application [None req-9e5ba275-966e-4767-9683-023450e71b48 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 09 00:59:42.195301 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 631/1283] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Dec 9 00:59:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:42.201522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bbdb7-d87e-4d96-806e-5c436c56c6ae admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:42.210599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bbdb7-d87e-4d96-806e-5c436c56c6ae admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:42.215118 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58542160-138c-496f-a534-f67a3a3fe58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:42.215733 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58542160-138c-496f-a534-f67a3a3fe58f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:42.216008 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58542160-138c-496f-a534-f67a3a3fe58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:42.216278 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58542160-138c-496f-a534-f67a3a3fe58f admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:42.217050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58542160-138c-496f-a534-f67a3a3fe58f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:42.217351 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58542160-138c-496f-a534-f67a3a3fe58f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:42.219221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58542160-138c-496f-a534-f67a3a3fe58f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:42.231328 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 653/1284] 10.222.0.23 () {56 vars in 1169 bytes} [Thu Dec 9 00:59:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:42.237906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ba275-966e-4767-9683-023450e71b48 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:42.248504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ba275-966e-4767-9683-023450e71b48 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:42.252966 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae0663-cc39-4986-a7bc-2be4c2dfdd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:42.253578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae0663-cc39-4986-a7bc-2be4c2dfdd65 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:42.253856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae0663-cc39-4986-a7bc-2be4c2dfdd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:42.254126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae0663-cc39-4986-a7bc-2be4c2dfdd65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:42.254982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae0663-cc39-4986-a7bc-2be4c2dfdd65 admin admin] RBAC: Adding query filter params (role.id=c041790a5f864dedae0b9f17b26e28ed, scope.project.id=0566d367619740a48d8dca2def78a386, user.id=a2cebb33ff7c4e40a06b3c7f1a40823d) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:42.255296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae0663-cc39-4986-a7bc-2be4c2dfdd65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:42.257091 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae0663-cc39-4986-a7bc-2be4c2dfdd65 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:42.263733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 632/1285] 10.222.0.23 () {56 vars in 1395 bytes} [Thu Dec 9 00:59:42 2021] GET /identity/v3/role_assignments?user.id=a2cebb33ff7c4e40a06b3c7f1a40823d&scope.project.id=0566d367619740a48d8dca2def78a386&role.id=c041790a5f864dedae0b9f17b26e28ed => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:44.632283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4a5b-2190-4bfc-be0d-ac32f4cd1400 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:44.632811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4a5b-2190-4bfc-be0d-ac32f4cd1400 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:44.632906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4a5b-2190-4bfc-be0d-ac32f4cd1400 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:44.634632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 654/1286] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:59:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:59:44.640782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e0b7a-a470-4fdf-a8e7-c69d116c753f None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:44.641160 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e0b7a-a470-4fdf-a8e7-c69d116c753f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:44.641330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e0b7a-a470-4fdf-a8e7-c69d116c753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:44.658251 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-661e0b7a-a470-4fdf-a8e7-c69d116c753f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:59:44.659464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-661e0b7a-a470-4fdf-a8e7-c69d116c753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:59:44.667128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 633/1287] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:59:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:59:44.690145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e4a5b-2190-4bfc-be0d-ac32f4cd1400 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:44.702572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e4a5b-2190-4bfc-be0d-ac32f4cd1400 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:44.707625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e71e60-8239-4980-b0c8-2de47ddc2e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:44.708378 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e71e60-8239-4980-b0c8-2de47ddc2e35 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:44.708657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e71e60-8239-4980-b0c8-2de47ddc2e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:44.708928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e71e60-8239-4980-b0c8-2de47ddc2e35 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:44.709582 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e71e60-8239-4980-b0c8-2de47ddc2e35 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:44.711172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e71e60-8239-4980-b0c8-2de47ddc2e35 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:44.721679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-66e71e60-8239-4980-b0c8-2de47ddc2e35 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 09 00:59:44.722811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 655/1288] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Dec 9 00:59:44 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 09 00:59:44.729245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e0b7a-a470-4fdf-a8e7-c69d116c753f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:44.738353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e0b7a-a470-4fdf-a8e7-c69d116c753f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:44.742879 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bdfef-4492-4d08-a6a4-c06b8d98e4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:44.743516 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bdfef-4492-4d08-a6a4-c06b8d98e4af admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:44.743797 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bdfef-4492-4d08-a6a4-c06b8d98e4af admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:44.744070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bdfef-4492-4d08-a6a4-c06b8d98e4af admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:44.745376 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bdfef-4492-4d08-a6a4-c06b8d98e4af admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:44.745677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bdfef-4492-4d08-a6a4-c06b8d98e4af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:44.747273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bdfef-4492-4d08-a6a4-c06b8d98e4af admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:44.751901 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 634/1289] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Dec 9 00:59:44 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:44.757641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e71e60-8239-4980-b0c8-2de47ddc2e35 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:44.767498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e71e60-8239-4980-b0c8-2de47ddc2e35 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:44.771914 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e33de8-6d88-42a4-8bf2-5d75e8cb5099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:44.772524 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e33de8-6d88-42a4-8bf2-5d75e8cb5099 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:44.772799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e33de8-6d88-42a4-8bf2-5d75e8cb5099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:44.773067 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e33de8-6d88-42a4-8bf2-5d75e8cb5099 admin admin] PATH_INFO: `/v3/services` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:44.773760 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e33de8-6d88-42a4-8bf2-5d75e8cb5099 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:44.774059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e33de8-6d88-42a4-8bf2-5d75e8cb5099 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:44.775637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e33de8-6d88-42a4-8bf2-5d75e8cb5099 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:44.779807 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 656/1290] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Dec 9 00:59:44 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:47.119314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac70acf-e58f-4d67-8fe9-d7ff4dd605e2 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:47.119894 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac70acf-e58f-4d67-8fe9-d7ff4dd605e2 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:47.119894 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac70acf-e58f-4d67-8fe9-d7ff4dd605e2 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:47.121526 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 635/1291] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:59:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:59:47.127108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63608f-785e-4f1e-8514-cea5a2f24a25 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:47.127475 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63608f-785e-4f1e-8514-cea5a2f24a25 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:47.127656 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63608f-785e-4f1e-8514-cea5a2f24a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:47.145248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-7d63608f-785e-4f1e-8514-cea5a2f24a25 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:59:47.146446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-7d63608f-785e-4f1e-8514-cea5a2f24a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:59:47.154699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 657/1292] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:59:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:59:47.181246 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac70acf-e58f-4d67-8fe9-d7ff4dd605e2 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:47.193405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac70acf-e58f-4d67-8fe9-d7ff4dd605e2 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:47.198291 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85de7c0-a288-49ae-95f0-38d4b3b2c4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:47.198959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85de7c0-a288-49ae-95f0-38d4b3b2c4ec admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:47.199288 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85de7c0-a288-49ae-95f0-38d4b3b2c4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:47.199586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85de7c0-a288-49ae-95f0-38d4b3b2c4ec admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:47.200721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85de7c0-a288-49ae-95f0-38d4b3b2c4ec admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:47.203464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85de7c0-a288-49ae-95f0-38d4b3b2c4ec admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:47.217581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 636/1293] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Dec 9 00:59:47 2021] POST /identity/v3/services => generated 246 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 00:59:49.561373 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4b374-e957-4ce3-9036-a09719108eaa None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:49.561932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4b374-e957-4ce3-9036-a09719108eaa None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:49.561932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4b374-e957-4ce3-9036-a09719108eaa None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:49.563704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 658/1294] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:59:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:59:49.569224 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50ea0c-afed-4836-b449-fdf80ba5d92e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:49.569637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50ea0c-afed-4836-b449-fdf80ba5d92e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:49.569777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50ea0c-afed-4836-b449-fdf80ba5d92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:49.587115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-5b50ea0c-afed-4836-b449-fdf80ba5d92e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:59:49.588315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5b50ea0c-afed-4836-b449-fdf80ba5d92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:59:49.604965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 637/1295] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:59:49 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:59:49.629312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4b374-e957-4ce3-9036-a09719108eaa None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:49.641807 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4b374-e957-4ce3-9036-a09719108eaa None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:49.646087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5cdb-29e7-40ff-9658-690dee2de0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:49.646877 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5cdb-29e7-40ff-9658-690dee2de0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:49.647158 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5cdb-29e7-40ff-9658-690dee2de0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:49.647430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5cdb-29e7-40ff-9658-690dee2de0a2 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:49.648089 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5cdb-29e7-40ff-9658-690dee2de0a2 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:49.649660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5cdb-29e7-40ff-9658-690dee2de0a2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:49.661200 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-fa9f5cdb-29e7-40ff-9658-690dee2de0a2 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 09 00:59:49.662301 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 659/1296] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Dec 9 00:59:49 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:49.669112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50ea0c-afed-4836-b449-fdf80ba5d92e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:49.677772 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50ea0c-afed-4836-b449-fdf80ba5d92e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:49.682627 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2026de1-04e1-4791-a543-b17b6beefa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:49.683266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2026de1-04e1-4791-a543-b17b6beefa41 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:49.683550 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2026de1-04e1-4791-a543-b17b6beefa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:49.683825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2026de1-04e1-4791-a543-b17b6beefa41 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:49.684655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2026de1-04e1-4791-a543-b17b6beefa41 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:49.684965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2026de1-04e1-4791-a543-b17b6beefa41 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:49.686579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2026de1-04e1-4791-a543-b17b6beefa41 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:49.691988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 638/1297] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Dec 9 00:59:49 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:49.699310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5cdb-29e7-40ff-9658-690dee2de0a2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:49.708909 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5cdb-29e7-40ff-9658-690dee2de0a2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:49.713911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d49c7-4e8e-4df2-b6af-2422894e2d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:49.714581 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d49c7-4e8e-4df2-b6af-2422894e2d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:49.714859 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d49c7-4e8e-4df2-b6af-2422894e2d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:49.715125 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d49c7-4e8e-4df2-b6af-2422894e2d06 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:49.715905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d49c7-4e8e-4df2-b6af-2422894e2d06 admin admin] RBAC: Adding query filter params (interface=public, service_id=aae481fe02464c458246c947f84321dd, region_id=RegionOne) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:49.716207 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d49c7-4e8e-4df2-b6af-2422894e2d06 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:49.717778 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d49c7-4e8e-4df2-b6af-2422894e2d06 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:49.722950 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 660/1298] 10.222.0.23 () {56 vars in 1272 bytes} [Thu Dec 9 00:59:49 2021] GET /identity/v3/endpoints?service_id=aae481fe02464c458246c947f84321dd&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:49.729946 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2026de1-04e1-4791-a543-b17b6beefa41 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:49.739715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2026de1-04e1-4791-a543-b17b6beefa41 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:49.744617 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca58b4-edd2-4513-87d7-f254c767a6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:49.745260 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca58b4-edd2-4513-87d7-f254c767a6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:49.745552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca58b4-edd2-4513-87d7-f254c767a6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:49.745827 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca58b4-edd2-4513-87d7-f254c767a6d1 admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:49.746547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca58b4-edd2-4513-87d7-f254c767a6d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:49.748125 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca58b4-edd2-4513-87d7-f254c767a6d1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:49.754661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 639/1299] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Dec 9 00:59:49 2021] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 00:59:52.097907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a657-91d7-4f62-9ce1-441b9a415b62 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:52.098456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a657-91d7-4f62-9ce1-441b9a415b62 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:52.098552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a657-91d7-4f62-9ce1-441b9a415b62 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:52.100315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 661/1300] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 00:59:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 00:59:52.105991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872cdf-9226-4671-9a28-986e857252bd None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:52.106408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872cdf-9226-4671-9a28-986e857252bd None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:52.106579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872cdf-9226-4671-9a28-986e857252bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:52.124440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-1a872cdf-9226-4671-9a28-986e857252bd None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 00:59:52.125619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-1a872cdf-9226-4671-9a28-986e857252bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 00:59:52.133006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 640/1301] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 00:59:52 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 00:59:52.157152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691a657-91d7-4f62-9ce1-441b9a415b62 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:52.168980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691a657-91d7-4f62-9ce1-441b9a415b62 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:52.173243 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440bbb1-be2a-4573-8319-6a856d185db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:52.173996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440bbb1-be2a-4573-8319-6a856d185db1 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:52.174273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440bbb1-be2a-4573-8319-6a856d185db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:52.174572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440bbb1-be2a-4573-8319-6a856d185db1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:52.175221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440bbb1-be2a-4573-8319-6a856d185db1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:52.176780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440bbb1-be2a-4573-8319-6a856d185db1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:52.187857 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING keystone.server.flask.application [None req-f440bbb1-be2a-4573-8319-6a856d185db1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 09 00:59:52.188939 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 662/1302] 10.222.0.23 () {56 vars in 1138 bytes} [Thu Dec 9 00:59:52 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 09 00:59:52.194989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a872cdf-9226-4671-9a28-986e857252bd None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:52.204333 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a872cdf-9226-4671-9a28-986e857252bd None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:52.208722 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01673463-173e-4a09-9772-6786b9f0299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:52.209463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01673463-173e-4a09-9772-6786b9f0299c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:52.209743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01673463-173e-4a09-9772-6786b9f0299c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:52.210011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01673463-173e-4a09-9772-6786b9f0299c admin admin] PATH_INFO: `/v3/services` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:52.210743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01673463-173e-4a09-9772-6786b9f0299c admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 00:59:52.211043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01673463-173e-4a09-9772-6786b9f0299c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:52.212596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01673463-173e-4a09-9772-6786b9f0299c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:52.217859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 641/1303] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Dec 9 00:59:52 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 00:59:52.223449 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440bbb1-be2a-4573-8319-6a856d185db1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 00:59:52.233331 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440bbb1-be2a-4573-8319-6a856d185db1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 00:59:52.237693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb565ee7-216d-47f2-a8ba-1d9187243184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 00:59:52.238289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565ee7-216d-47f2-a8ba-1d9187243184 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 00:59:52.238606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565ee7-216d-47f2-a8ba-1d9187243184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 00:59:52.238895 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565ee7-216d-47f2-a8ba-1d9187243184 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 00:59:52.239628 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb565ee7-216d-47f2-a8ba-1d9187243184 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 00:59:52.241151 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb565ee7-216d-47f2-a8ba-1d9187243184 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 00:59:52.260726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 663/1304] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Dec 9 00:59:52 2021] POST /identity/v3/endpoints => generated 331 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:00:55.356492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c56595-d858-49a0-bec7-251dd6c41d53 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:00:55.357077 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c56595-d858-49a0-bec7-251dd6c41d53 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:00:55.357077 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c56595-d858-49a0-bec7-251dd6c41d53 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:00:55.358824 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 642/1305] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:00:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:00:55.368741 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847381e-e58b-45d9-8476-44c7512995fd None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:00:55.369630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847381e-e58b-45d9-8476-44c7512995fd None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:00:55.370123 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847381e-e58b-45d9-8476-44c7512995fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:00:55.524302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9847381e-e58b-45d9-8476-44c7512995fd None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:00:55.526175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9847381e-e58b-45d9-8476-44c7512995fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:00:55.713120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 664/1306] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:00:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:00:55.737568 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c56595-d858-49a0-bec7-251dd6c41d53 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:00:55.739856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-27c56595-d858-49a0-bec7-251dd6c41d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:00:55.957833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c56595-d858-49a0-bec7-251dd6c41d53 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:00:56.151415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6cbc0-feaa-48b6-8c77-443f0a6b2ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:00:56.152549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6cbc0-feaa-48b6-8c77-443f0a6b2ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:00:56.153032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6cbc0-feaa-48b6-8c77-443f0a6b2ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:00:56.153545 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6cbc0-feaa-48b6-8c77-443f0a6b2ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:00:56.154571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6cbc0-feaa-48b6-8c77-443f0a6b2ce5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:00:56.156935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6cbc0-feaa-48b6-8c77-443f0a6b2ce5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:00:56.181051 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 643/1307] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Dec 9 01:00:55 2021] GET /identity/v3/projects => generated 2553 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:00:58.686600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf5370-6f13-40a9-8351-aa110ba18057 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:00:58.687107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf5370-6f13-40a9-8351-aa110ba18057 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:00:58.687107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf5370-6f13-40a9-8351-aa110ba18057 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:00:58.688815 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 665/1308] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:00:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:00:58.695068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f68799-71ea-421e-b9fc-b6b6be976abe None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:00:58.695486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f68799-71ea-421e-b9fc-b6b6be976abe None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:00:58.695752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f68799-71ea-421e-b9fc-b6b6be976abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:00:58.765106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-46f68799-71ea-421e-b9fc-b6b6be976abe None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:00:58.766304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-46f68799-71ea-421e-b9fc-b6b6be976abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:00:58.864377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 644/1309] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:00:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:00:58.917417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13934538-c27d-493d-a34a-88700040c5f0 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:00:58.917700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13934538-c27d-493d-a34a-88700040c5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:00:58.917974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13934538-c27d-493d-a34a-88700040c5f0 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:00:58.919776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 666/1310] 10.222.0.23 () {54 vars in 964 bytes} [Thu Dec 9 01:00:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:00:58.925886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567f11a-0eb2-4e9b-807c-5f2bdbd2b62d None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:00:58.926167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567f11a-0eb2-4e9b-807c-5f2bdbd2b62d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:00:58.926467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567f11a-0eb2-4e9b-807c-5f2bdbd2b62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:00:58.999824 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-a567f11a-0eb2-4e9b-807c-5f2bdbd2b62d None None] MFA Rules not processed for user `0ab73b6f3a1949359549f91e1b708600`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:00:59.000925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a567f11a-0eb2-4e9b-807c-5f2bdbd2b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:00:59.073790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 645/1311] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Dec 9 01:00:58 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:00:59.083118 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13934538-c27d-493d-a34a-88700040c5f0 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:00:59.084630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-13934538-c27d-493d-a34a-88700040c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:00:59.185971 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13934538-c27d-493d-a34a-88700040c5f0 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:00:59.259061 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99787296-4dc9-4ffd-afcc-8189be615d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:00:59.259624 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99787296-4dc9-4ffd-afcc-8189be615d32 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:00:59.259906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99787296-4dc9-4ffd-afcc-8189be615d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:00:59.260178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99787296-4dc9-4ffd-afcc-8189be615d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:00:59.261798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-99787296-4dc9-4ffd-afcc-8189be615d32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:00:59.368959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99787296-4dc9-4ffd-afcc-8189be615d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:00:59.370435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99787296-4dc9-4ffd-afcc-8189be615d32 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:00:59.388163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 667/1312] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:00:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:02.017013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1563319-31bd-48ac-8f30-92295b0c2fb0 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:02.017414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1563319-31bd-48ac-8f30-92295b0c2fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:02.017570 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1563319-31bd-48ac-8f30-92295b0c2fb0 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:02.019379 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 646/1313] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:02.025827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271144-e0d1-48e5-8c8f-b76a74d0570a None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:02.026234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271144-e0d1-48e5-8c8f-b76a74d0570a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:02.026442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271144-e0d1-48e5-8c8f-b76a74d0570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:02.089979 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-75271144-e0d1-48e5-8c8f-b76a74d0570a None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:02.091207 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-75271144-e0d1-48e5-8c8f-b76a74d0570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:02.184388 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 668/1314] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:02.225044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1563319-31bd-48ac-8f30-92295b0c2fb0 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:02.226609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f1563319-31bd-48ac-8f30-92295b0c2fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:02.325849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1563319-31bd-48ac-8f30-92295b0c2fb0 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:02.396180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c17378-6105-428e-9511-8d83a12df618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:02.396831 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c17378-6105-428e-9511-8d83a12df618 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:02.397173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c17378-6105-428e-9511-8d83a12df618 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:02.398062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c17378-6105-428e-9511-8d83a12df618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:02.399946 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f4c17378-6105-428e-9511-8d83a12df618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:02.504603 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c17378-6105-428e-9511-8d83a12df618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:02.505944 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c17378-6105-428e-9511-8d83a12df618 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:02.524219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 647/1315] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:05.241631 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad101-22b2-4e68-8837-edab5b44c5fe None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:05.242133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad101-22b2-4e68-8837-edab5b44c5fe None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:05.242133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad101-22b2-4e68-8837-edab5b44c5fe None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:05.243913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 669/1316] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:05.249524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01968c-0eaa-48fa-9724-9fc21ae57aac None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:05.249968 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01968c-0eaa-48fa-9724-9fc21ae57aac None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:05.250063 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01968c-0eaa-48fa-9724-9fc21ae57aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:05.312012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-1a01968c-0eaa-48fa-9724-9fc21ae57aac None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:05.313216 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-1a01968c-0eaa-48fa-9724-9fc21ae57aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:05.405364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 648/1317] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:05.441414 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ad101-22b2-4e68-8837-edab5b44c5fe None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:05.442974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f15ad101-22b2-4e68-8837-edab5b44c5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:05.565024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ad101-22b2-4e68-8837-edab5b44c5fe None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:05.657009 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f69185-fef1-473f-97cc-711b7e14f09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:05.657849 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f69185-fef1-473f-97cc-711b7e14f09c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:05.658127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f69185-fef1-473f-97cc-711b7e14f09c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:05.658424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f69185-fef1-473f-97cc-711b7e14f09c admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:05.668318 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f69185-fef1-473f-97cc-711b7e14f09c admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:05.670331 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f69185-fef1-473f-97cc-711b7e14f09c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:05.672043 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 670/1318] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 01:01:05 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:01:05.701080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1bb1f-30a6-414a-90c3-a2ebafc17d30 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:05.701364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1bb1f-30a6-414a-90c3-a2ebafc17d30 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:05.701640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1bb1f-30a6-414a-90c3-a2ebafc17d30 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:05.703538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 649/1319] 10.222.0.23 () {54 vars in 964 bytes} [Thu Dec 9 01:01:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:05.709610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02143-b07d-4a38-a4fa-0ba4c8e69c05 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:05.710112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02143-b07d-4a38-a4fa-0ba4c8e69c05 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:05.710552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02143-b07d-4a38-a4fa-0ba4c8e69c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:05.783354 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-cca02143-b07d-4a38-a4fa-0ba4c8e69c05 None None] MFA Rules not processed for user `0ab73b6f3a1949359549f91e1b708600`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:05.784556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cca02143-b07d-4a38-a4fa-0ba4c8e69c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:05.857812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 671/1320] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Dec 9 01:01:05 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:05.867719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1bb1f-30a6-414a-90c3-a2ebafc17d30 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:05.869246 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2cd1bb1f-30a6-414a-90c3-a2ebafc17d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:05.971930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1bb1f-30a6-414a-90c3-a2ebafc17d30 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:06.041429 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca55fa-01d0-4f14-b28c-009a99d508eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:06.042063 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca55fa-01d0-4f14-b28c-009a99d508eb service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:06.042345 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca55fa-01d0-4f14-b28c-009a99d508eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:06.042647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca55fa-01d0-4f14-b28c-009a99d508eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:06.044258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7cca55fa-01d0-4f14-b28c-009a99d508eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:06.145136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca55fa-01d0-4f14-b28c-009a99d508eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:06.146498 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca55fa-01d0-4f14-b28c-009a99d508eb service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:06.164309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 650/1321] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:09.520215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e3448-ce58-443d-9d75-2f645c4335d3 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:09.520826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e3448-ce58-443d-9d75-2f645c4335d3 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:09.520826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e3448-ce58-443d-9d75-2f645c4335d3 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:09.523263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 672/1322] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:09.528920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa6bbf-f1f9-41e1-b690-d8272b3d8f34 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:09.529370 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa6bbf-f1f9-41e1-b690-d8272b3d8f34 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:09.529473 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa6bbf-f1f9-41e1-b690-d8272b3d8f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:09.595677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-7cfa6bbf-f1f9-41e1-b690-d8272b3d8f34 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:09.596908 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7cfa6bbf-f1f9-41e1-b690-d8272b3d8f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:09.689120 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 651/1323] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:09.724544 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e3448-ce58-443d-9d75-2f645c4335d3 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:09.726087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1e0e3448-ce58-443d-9d75-2f645c4335d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:09.848098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e3448-ce58-443d-9d75-2f645c4335d3 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:09.936192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41291d-7f24-492b-88fe-d9396749dd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:09.937028 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41291d-7f24-492b-88fe-d9396749dd8d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:09.937303 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41291d-7f24-492b-88fe-d9396749dd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:09.937569 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41291d-7f24-492b-88fe-d9396749dd8d admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:09.947614 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41291d-7f24-492b-88fe-d9396749dd8d admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:09.949668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41291d-7f24-492b-88fe-d9396749dd8d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:09.951394 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 673/1324] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 01:01:09 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:01:09.963876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa6bbf-f1f9-41e1-b690-d8272b3d8f34 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:09.965068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7cfa6bbf-f1f9-41e1-b690-d8272b3d8f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:10.050134 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa6bbf-f1f9-41e1-b690-d8272b3d8f34 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:10.118886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675ddc7-29b1-459c-a133-228e7784675b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:10.119451 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675ddc7-29b1-459c-a133-228e7784675b service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:10.119725 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675ddc7-29b1-459c-a133-228e7784675b service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:10.119998 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675ddc7-29b1-459c-a133-228e7784675b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:10.121606 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-1675ddc7-29b1-459c-a133-228e7784675b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:10.223083 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675ddc7-29b1-459c-a133-228e7784675b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:10.224496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675ddc7-29b1-459c-a133-228e7784675b service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:10.242314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 652/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:13.237532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7c1c-2afc-4a84-8b97-532130b155c6 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:13.237941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7c1c-2afc-4a84-8b97-532130b155c6 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:13.238079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7c1c-2afc-4a84-8b97-532130b155c6 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:13.239885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 674/1326] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:13.245882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8fab8-73b2-4312-b6b8-9fb5c9f9d510 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:13.246301 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8fab8-73b2-4312-b6b8-9fb5c9f9d510 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:13.246589 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8fab8-73b2-4312-b6b8-9fb5c9f9d510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:13.311909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-ceb8fab8-73b2-4312-b6b8-9fb5c9f9d510 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:13.313095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ceb8fab8-73b2-4312-b6b8-9fb5c9f9d510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:13.406081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 653/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:13.443131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b7c1c-2afc-4a84-8b97-532130b155c6 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:13.445420 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-8f6b7c1c-2afc-4a84-8b97-532130b155c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:13.545344 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b7c1c-2afc-4a84-8b97-532130b155c6 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:13.615713 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3ae8b-8cef-4864-94f6-62cbabc7cf70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:13.616352 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3ae8b-8cef-4864-94f6-62cbabc7cf70 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:13.616629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3ae8b-8cef-4864-94f6-62cbabc7cf70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:13.616899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3ae8b-8cef-4864-94f6-62cbabc7cf70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:13.618540 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-17f3ae8b-8cef-4864-94f6-62cbabc7cf70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:13.722786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3ae8b-8cef-4864-94f6-62cbabc7cf70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:13.724239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3ae8b-8cef-4864-94f6-62cbabc7cf70 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:13.743030 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 675/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:16.164421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd8b85-53ba-4500-baa4-136ea7a1b50f None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:16.164948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd8b85-53ba-4500-baa4-136ea7a1b50f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:16.164948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd8b85-53ba-4500-baa4-136ea7a1b50f None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:16.166724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 654/1329] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:16.172515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143a7b3-de37-4a4e-9f41-d3516f8479cd None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:16.172944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143a7b3-de37-4a4e-9f41-d3516f8479cd None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:16.173066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143a7b3-de37-4a4e-9f41-d3516f8479cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:16.236225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2143a7b3-de37-4a4e-9f41-d3516f8479cd None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:16.237432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2143a7b3-de37-4a4e-9f41-d3516f8479cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:16.329266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 676/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:16.367412 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd8b85-53ba-4500-baa4-136ea7a1b50f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:16.368992 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-19cd8b85-53ba-4500-baa4-136ea7a1b50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:16.471451 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd8b85-53ba-4500-baa4-136ea7a1b50f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:16.548757 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0ce3a-91b5-44ab-b281-c449b0572a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:16.549399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0ce3a-91b5-44ab-b281-c449b0572a0d service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:16.549683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0ce3a-91b5-44ab-b281-c449b0572a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:16.549960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0ce3a-91b5-44ab-b281-c449b0572a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:16.551609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b4e0ce3a-91b5-44ab-b281-c449b0572a0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:16.657168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0ce3a-91b5-44ab-b281-c449b0572a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:16.658624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0ce3a-91b5-44ab-b281-c449b0572a0d service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:16.676282 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 655/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:19.211095 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e066ce-c568-4ce3-b268-ff946c7c0300 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:19.211603 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e066ce-c568-4ce3-b268-ff946c7c0300 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:19.211603 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e066ce-c568-4ce3-b268-ff946c7c0300 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:19.213355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 677/1332] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:19.219225 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2532f72-1359-4e5c-b5f7-48b218718454 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:19.219671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2532f72-1359-4e5c-b5f7-48b218718454 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:19.219778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2532f72-1359-4e5c-b5f7-48b218718454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:19.283399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-f2532f72-1359-4e5c-b5f7-48b218718454 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:19.284598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f2532f72-1359-4e5c-b5f7-48b218718454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:19.379040 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 656/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:19.415970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e066ce-c568-4ce3-b268-ff946c7c0300 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:19.417525 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a0e066ce-c568-4ce3-b268-ff946c7c0300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:19.545342 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e066ce-c568-4ce3-b268-ff946c7c0300 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:19.637790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd219e93-3312-4d62-9c63-a938bc3f0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:19.638671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd219e93-3312-4d62-9c63-a938bc3f0732 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:19.638958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd219e93-3312-4d62-9c63-a938bc3f0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:19.639230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd219e93-3312-4d62-9c63-a938bc3f0732 admin admin] PATH_INFO: `/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:19.649427 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd219e93-3312-4d62-9c63-a938bc3f0732 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbc52dd5f424931a362b9a5e7697c8b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:19.651536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd219e93-3312-4d62-9c63-a938bc3f0732 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:19.653239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 678/1334] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Dec 9 01:01:19 2021] GET /identity/v3/projects/3dbc52dd5f424931a362b9a5e7697c8b => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:01:19.665871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2532f72-1359-4e5c-b5f7-48b218718454 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:19.667191 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f2532f72-1359-4e5c-b5f7-48b218718454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:19.760855 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2532f72-1359-4e5c-b5f7-48b218718454 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:19.831242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd9d53-bc89-4e11-bd0d-340fe59cdeab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:19.831889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9d53-bc89-4e11-bd0d-340fe59cdeab service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:19.832169 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9d53-bc89-4e11-bd0d-340fe59cdeab service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:19.832438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9d53-bc89-4e11-bd0d-340fe59cdeab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:19.834881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-28dd9d53-bc89-4e11-bd0d-340fe59cdeab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:19.952086 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd9d53-bc89-4e11-bd0d-340fe59cdeab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:19.953525 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd9d53-bc89-4e11-bd0d-340fe59cdeab service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:19.972646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 657/1335] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:22.633920 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c082ff-7bc9-47d4-94c4-93f515e300f0 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:22.634472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c082ff-7bc9-47d4-94c4-93f515e300f0 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:22.634472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c082ff-7bc9-47d4-94c4-93f515e300f0 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:22.636307 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 679/1336] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:22.641886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8981f9-1321-4f65-8140-7cf647c8639d None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:22.642281 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8981f9-1321-4f65-8140-7cf647c8639d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:22.642480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8981f9-1321-4f65-8140-7cf647c8639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:22.712550 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-ea8981f9-1321-4f65-8140-7cf647c8639d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:22.713756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ea8981f9-1321-4f65-8140-7cf647c8639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:22.806844 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 658/1337] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:22.844865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c082ff-7bc9-47d4-94c4-93f515e300f0 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:22.846408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-07c082ff-7bc9-47d4-94c4-93f515e300f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:22.945585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c082ff-7bc9-47d4-94c4-93f515e300f0 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:23.019338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522c702-3836-44d3-9345-91c6a697efbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:23.019985 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c702-3836-44d3-9345-91c6a697efbf service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:23.020265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c702-3836-44d3-9345-91c6a697efbf service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:23.020537 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c702-3836-44d3-9345-91c6a697efbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:23.022273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2522c702-3836-44d3-9345-91c6a697efbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:23.128640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522c702-3836-44d3-9345-91c6a697efbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:23.130103 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522c702-3836-44d3-9345-91c6a697efbf service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:23.148473 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 680/1338] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:25.564200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48c693-550a-4b00-81df-ffe4fb287176 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:25.564756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48c693-550a-4b00-81df-ffe4fb287176 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:25.564756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48c693-550a-4b00-81df-ffe4fb287176 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:25.566580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 659/1339] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:25.572762 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d42f05-f845-4d24-a0f4-347fa0235efc None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:25.573179 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d42f05-f845-4d24-a0f4-347fa0235efc None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:25.573309 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d42f05-f845-4d24-a0f4-347fa0235efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:25.640981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-13d42f05-f845-4d24-a0f4-347fa0235efc None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:25.642160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-13d42f05-f845-4d24-a0f4-347fa0235efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:25.740746 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 681/1340] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:25.782578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48c693-550a-4b00-81df-ffe4fb287176 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:25.784729 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-3b48c693-550a-4b00-81df-ffe4fb287176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:25.878957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48c693-550a-4b00-81df-ffe4fb287176 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:25.891111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4ac14-610a-479e-bbbb-6d35736b3dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:25.891752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4ac14-610a-479e-bbbb-6d35736b3dba service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:25.892038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4ac14-610a-479e-bbbb-6d35736b3dba service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:25.892315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4ac14-610a-479e-bbbb-6d35736b3dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:25.902960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4ac14-610a-479e-bbbb-6d35736b3dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:25.904665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4ac14-610a-479e-bbbb-6d35736b3dba service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:25.923238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 660/1341] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:28.599762 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14147178-7ebd-46cb-b78d-264c1ac37e2f None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:28.600322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14147178-7ebd-46cb-b78d-264c1ac37e2f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:28.600322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14147178-7ebd-46cb-b78d-264c1ac37e2f None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:28.602090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 682/1342] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:28.608074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577b1ba-cbc0-47b4-8061-c898e009e4c4 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:28.608471 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577b1ba-cbc0-47b4-8061-c898e009e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:28.608629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577b1ba-cbc0-47b4-8061-c898e009e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:28.628094 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d577b1ba-cbc0-47b4-8061-c898e009e4c4 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:28.629275 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d577b1ba-cbc0-47b4-8061-c898e009e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:28.637726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 661/1343] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:28.676165 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14147178-7ebd-46cb-b78d-264c1ac37e2f None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:28.695290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14147178-7ebd-46cb-b78d-264c1ac37e2f None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:28.698709 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdd31d-51f7-4037-9757-051bb57b04aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:28.699360 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdd31d-51f7-4037-9757-051bb57b04aa service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:28.699640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdd31d-51f7-4037-9757-051bb57b04aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:28.699936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdd31d-51f7-4037-9757-051bb57b04aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:28.709164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdd31d-51f7-4037-9757-051bb57b04aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:28.710612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdd31d-51f7-4037-9757-051bb57b04aa service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:28.719794 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 683/1344] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:33.014504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2067ee3-586f-4525-a3a9-83eab188ce2c None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:33.015023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2067ee3-586f-4525-a3a9-83eab188ce2c None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:33.015140 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2067ee3-586f-4525-a3a9-83eab188ce2c None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:33.016808 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 662/1345] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:33.022622 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901b9fa-5b22-4789-be55-7bc18b74d7bc None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:33.023056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901b9fa-5b22-4789-be55-7bc18b74d7bc None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:33.023206 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901b9fa-5b22-4789-be55-7bc18b74d7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:33.042262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e901b9fa-5b22-4789-be55-7bc18b74d7bc None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:33.043493 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e901b9fa-5b22-4789-be55-7bc18b74d7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:33.051153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 684/1346] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:01:33.091472 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2067ee3-586f-4525-a3a9-83eab188ce2c None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:33.103007 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2067ee3-586f-4525-a3a9-83eab188ce2c None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:33.106833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a11a2-78b8-4ce7-b488-69c52af28044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:33.107577 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a11a2-78b8-4ce7-b488-69c52af28044 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:33.107858 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a11a2-78b8-4ce7-b488-69c52af28044 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:33.108157 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a11a2-78b8-4ce7-b488-69c52af28044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:33.117603 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a11a2-78b8-4ce7-b488-69c52af28044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:33.119056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a11a2-78b8-4ce7-b488-69c52af28044 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:33.128281 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 663/1347] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:36.128010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f5074-fbb3-4677-b3b3-e7b715dd1667 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:36.128509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f5074-fbb3-4677-b3b3-e7b715dd1667 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:36.128509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f5074-fbb3-4677-b3b3-e7b715dd1667 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:36.130456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 685/1348] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:36.136544 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3038b38-36ca-4a8b-8cf5-9116e738d880 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:36.136952 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3038b38-36ca-4a8b-8cf5-9116e738d880 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:36.137100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3038b38-36ca-4a8b-8cf5-9116e738d880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:36.155008 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e3038b38-36ca-4a8b-8cf5-9116e738d880 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:36.156208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e3038b38-36ca-4a8b-8cf5-9116e738d880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:36.164780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 664/1349] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:36.203362 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f5074-fbb3-4677-b3b3-e7b715dd1667 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:36.214587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f5074-fbb3-4677-b3b3-e7b715dd1667 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:36.218214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151b44f-993a-4a5f-88cd-2b2c9d93ba4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:36.218979 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151b44f-993a-4a5f-88cd-2b2c9d93ba4b service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:36.219361 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151b44f-993a-4a5f-88cd-2b2c9d93ba4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:36.219724 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151b44f-993a-4a5f-88cd-2b2c9d93ba4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:36.229529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151b44f-993a-4a5f-88cd-2b2c9d93ba4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:36.231249 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151b44f-993a-4a5f-88cd-2b2c9d93ba4b service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:36.240698 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 686/1350] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:40.858254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823c69f-bfc1-435a-8cbb-e587ff94f744 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:40.858803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823c69f-bfc1-435a-8cbb-e587ff94f744 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:40.858907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823c69f-bfc1-435a-8cbb-e587ff94f744 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:40.860676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 665/1351] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 01:01:40.869092 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca820167-9858-4fd8-9941-c8456aa78265 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:40.869595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca820167-9858-4fd8-9941-c8456aa78265 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:40.869830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca820167-9858-4fd8-9941-c8456aa78265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:40.893903 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ca820167-9858-4fd8-9941-c8456aa78265 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:40.895527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ca820167-9858-4fd8-9941-c8456aa78265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:40.906194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 687/1352] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:40.945885 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823c69f-bfc1-435a-8cbb-e587ff94f744 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:40.956894 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823c69f-bfc1-435a-8cbb-e587ff94f744 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:40.960702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22726-c4f7-4751-9ff7-15ce40e193d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:40.961335 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22726-c4f7-4751-9ff7-15ce40e193d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:40.961617 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22726-c4f7-4751-9ff7-15ce40e193d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:40.961890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22726-c4f7-4751-9ff7-15ce40e193d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:40.971011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba22726-c4f7-4751-9ff7-15ce40e193d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:40.972591 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba22726-c4f7-4751-9ff7-15ce40e193d2 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:40.983233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 666/1353] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:46.324570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d52b1-a1bf-450b-a02c-c39ef8262f5b None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:46.325094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d52b1-a1bf-450b-a02c-c39ef8262f5b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:46.325094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d52b1-a1bf-450b-a02c-c39ef8262f5b None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:46.327427 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 688/1354] 10.222.0.23 () {54 vars in 921 bytes} [Thu Dec 9 01:01:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:46.332671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22587-08d9-4085-b8a8-5f6223e0452d None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:46.333165 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22587-08d9-4085-b8a8-5f6223e0452d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:46.333266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22587-08d9-4085-b8a8-5f6223e0452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:46.405769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-00a22587-08d9-4085-b8a8-5f6223e0452d None None] MFA Rules not processed for user `a2cebb33ff7c4e40a06b3c7f1a40823d`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:46.407479 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-00a22587-08d9-4085-b8a8-5f6223e0452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:46.497802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 667/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Dec 9 01:01:46 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:50.613642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caec3b7-3505-4806-94a4-fbcefafa5833 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:50.614228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caec3b7-3505-4806-94a4-fbcefafa5833 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:50.614761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caec3b7-3505-4806-94a4-fbcefafa5833 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:50.616857 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 689/1356] 10.222.0.23 () {54 vars in 921 bytes} [Thu Dec 9 01:01:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:50.622320 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2263f-bbf0-4558-ae4b-6170bb2d6ef7 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:50.623128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2263f-bbf0-4558-ae4b-6170bb2d6ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:50.623415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2263f-bbf0-4558-ae4b-6170bb2d6ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:50.641765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-dec2263f-bbf0-4558-ae4b-6170bb2d6ef7 None None] MFA Rules not processed for user `a2cebb33ff7c4e40a06b3c7f1a40823d`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:50.643152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-dec2263f-bbf0-4558-ae4b-6170bb2d6ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:50.652504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 668/1357] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Dec 9 01:01:50 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:52.140279 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043d1c-3a96-419e-96e6-23a9f04028e4 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:52.140783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043d1c-3a96-419e-96e6-23a9f04028e4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:52.141172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043d1c-3a96-419e-96e6-23a9f04028e4 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:52.143524 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 690/1358] 10.222.0.23 () {54 vars in 921 bytes} [Thu Dec 9 01:01:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:52.149763 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103f6b9-4c2c-4082-b2a7-ba0b294499f2 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:52.150549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103f6b9-4c2c-4082-b2a7-ba0b294499f2 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:52.150549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103f6b9-4c2c-4082-b2a7-ba0b294499f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:52.169096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-2103f6b9-4c2c-4082-b2a7-ba0b294499f2 None None] MFA Rules not processed for user `a2cebb33ff7c4e40a06b3c7f1a40823d`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:52.170353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2103f6b9-4c2c-4082-b2a7-ba0b294499f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:52.179378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 669/1359] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Dec 9 01:01:52 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:56.181439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ff30-ea62-4d43-a28b-99e25687cba6 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:56.181954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ff30-ea62-4d43-a28b-99e25687cba6 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:56.182035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ff30-ea62-4d43-a28b-99e25687cba6 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:56.183753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 691/1360] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:56.189446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159f59f-bca0-4815-bb15-f0632f5f00fd None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:56.189839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159f59f-bca0-4815-bb15-f0632f5f00fd None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:56.190115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159f59f-bca0-4815-bb15-f0632f5f00fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:56.209965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-2159f59f-bca0-4815-bb15-f0632f5f00fd None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:56.211198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2159f59f-bca0-4815-bb15-f0632f5f00fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:56.219220 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 670/1361] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:56.270613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761becd-bfc4-4827-bee1-d34e3ddfebea None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:56.271289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761becd-bfc4-4827-bee1-d34e3ddfebea None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:56.271576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761becd-bfc4-4827-bee1-d34e3ddfebea None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:56.273596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 692/1362] 10.222.0.23 () {54 vars in 961 bytes} [Thu Dec 9 01:01:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 01:01:56.288713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b254-6b3c-4084-8cf4-102ff6838717 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:56.289003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b254-6b3c-4084-8cf4-102ff6838717 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:56.289284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b254-6b3c-4084-8cf4-102ff6838717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:56.340566 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d467b254-6b3c-4084-8cf4-102ff6838717 None None] MFA Rules not processed for user `53d32ba063bc4a719d4c2f67d88ec640`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:56.341687 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d467b254-6b3c-4084-8cf4-102ff6838717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:56.422894 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 671/1363] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Dec 9 01:01:56 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:01:56.431192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761becd-bfc4-4827-bee1-d34e3ddfebea None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:56.445140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761becd-bfc4-4827-bee1-d34e3ddfebea None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:56.450521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dff11a-261b-44d1-ae4b-9ebca7a83170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:56.451145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dff11a-261b-44d1-ae4b-9ebca7a83170 service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:56.451427 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dff11a-261b-44d1-ae4b-9ebca7a83170 service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:56.451738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dff11a-261b-44d1-ae4b-9ebca7a83170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:56.460291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dff11a-261b-44d1-ae4b-9ebca7a83170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:56.462258 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dff11a-261b-44d1-ae4b-9ebca7a83170 service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:56.472568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 693/1364] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:01:59.060085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0047054-e152-4165-b13b-f62ed18a9822 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:59.060595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0047054-e152-4165-b13b-f62ed18a9822 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:59.060676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0047054-e152-4165-b13b-f62ed18a9822 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:59.062405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 672/1365] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:01:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:01:59.068141 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eba785-f0dc-45ef-9a8f-915d66bae2a9 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:59.068530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eba785-f0dc-45ef-9a8f-915d66bae2a9 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:59.068683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eba785-f0dc-45ef-9a8f-915d66bae2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:59.086210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-74eba785-f0dc-45ef-9a8f-915d66bae2a9 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:01:59.087411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-74eba785-f0dc-45ef-9a8f-915d66bae2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:01:59.095133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 694/1366] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:01:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:01:59.140741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0047054-e152-4165-b13b-f62ed18a9822 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:01:59.159457 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0047054-e152-4165-b13b-f62ed18a9822 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:01:59.166558 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2521bb-e3ba-4bc2-910c-2ad3276b99dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:01:59.167193 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2521bb-e3ba-4bc2-910c-2ad3276b99dd service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:01:59.167474 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2521bb-e3ba-4bc2-910c-2ad3276b99dd service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:01:59.167747 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2521bb-e3ba-4bc2-910c-2ad3276b99dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:01:59.176926 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2521bb-e3ba-4bc2-910c-2ad3276b99dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:01:59.178559 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2521bb-e3ba-4bc2-910c-2ad3276b99dd service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:01:59.188672 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 673/1367] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:01:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:01.895496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129a1ae-a158-4fb5-9d0d-f0d0179faf81 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:01.896579 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129a1ae-a158-4fb5-9d0d-f0d0179faf81 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:01.896863 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129a1ae-a158-4fb5-9d0d-f0d0179faf81 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:01.899159 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 695/1368] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:02:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:01.904822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99b36-6327-4e37-a7b4-333163f9a7f7 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:01.905287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99b36-6327-4e37-a7b4-333163f9a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:01.905382 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99b36-6327-4e37-a7b4-333163f9a7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:01.925804 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e3f99b36-6327-4e37-a7b4-333163f9a7f7 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:01.927656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e3f99b36-6327-4e37-a7b4-333163f9a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:01.936702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 674/1369] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:02:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:02:01.985285 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea45810-b7b4-4707-bef7-e0fa79dea817 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:01.986032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea45810-b7b4-4707-bef7-e0fa79dea817 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:01.986590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea45810-b7b4-4707-bef7-e0fa79dea817 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:01.988997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 696/1370] 10.222.0.23 () {54 vars in 961 bytes} [Thu Dec 9 01:02:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:01.996514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a2eea-8ae9-4fab-a130-e454d87daff2 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:01.997030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a2eea-8ae9-4fab-a130-e454d87daff2 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:01.997311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a2eea-8ae9-4fab-a130-e454d87daff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:02.019026 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-476a2eea-8ae9-4fab-a130-e454d87daff2 None None] MFA Rules not processed for user `53d32ba063bc4a719d4c2f67d88ec640`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:02.020766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-476a2eea-8ae9-4fab-a130-e454d87daff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:02.038545 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 675/1371] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Dec 9 01:02:01 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:02.040323 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea45810-b7b4-4707-bef7-e0fa79dea817 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:02.054912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea45810-b7b4-4707-bef7-e0fa79dea817 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:02.061100 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba516d0-6bdb-45c1-b8b5-6e512850301a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:02.061937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba516d0-6bdb-45c1-b8b5-6e512850301a service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:02.062286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba516d0-6bdb-45c1-b8b5-6e512850301a service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:02.062715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba516d0-6bdb-45c1-b8b5-6e512850301a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:02.072813 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba516d0-6bdb-45c1-b8b5-6e512850301a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:02.074484 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba516d0-6bdb-45c1-b8b5-6e512850301a service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:02.085507 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 697/1372] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:04.213964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b296-55c0-4271-a958-b541c298fd52 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:04.214562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b296-55c0-4271-a958-b541c298fd52 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:04.214562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b296-55c0-4271-a958-b541c298fd52 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:04.216244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 676/1373] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:02:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:04.223563 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e455e-ca7e-4824-a667-2969b91e49b2 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:04.224107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e455e-ca7e-4824-a667-2969b91e49b2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:04.224107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e455e-ca7e-4824-a667-2969b91e49b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:04.242824 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9a7e455e-ca7e-4824-a667-2969b91e49b2 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:04.244011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9a7e455e-ca7e-4824-a667-2969b91e49b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:04.251826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 698/1374] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:02:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:04.309928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b9a8e-c5b4-404b-9f20-8d5e051f1823 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:04.310270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b9a8e-c5b4-404b-9f20-8d5e051f1823 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:04.310541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b9a8e-c5b4-404b-9f20-8d5e051f1823 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:04.312705 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 677/1375] 10.222.0.23 () {54 vars in 963 bytes} [Thu Dec 9 01:02:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:04.318924 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb882c4-ccd1-417f-87c3-49af64b40218 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:04.319343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb882c4-ccd1-417f-87c3-49af64b40218 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:04.319729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb882c4-ccd1-417f-87c3-49af64b40218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:04.373980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-6eb882c4-ccd1-417f-87c3-49af64b40218 None None] MFA Rules not processed for user `fb5625c813724729bb927c201f23e417`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:04.375448 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6eb882c4-ccd1-417f-87c3-49af64b40218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:04.440229 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 699/1376] 10.222.0.23 () {58 vars in 1060 bytes} [Thu Dec 9 01:02:04 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:04.448879 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b9a8e-c5b4-404b-9f20-8d5e051f1823 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:04.460431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b9a8e-c5b4-404b-9f20-8d5e051f1823 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:04.464133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52648d85-c5e2-47ca-a5f3-0124fde95ece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:04.464705 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52648d85-c5e2-47ca-a5f3-0124fde95ece service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:04.464982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52648d85-c5e2-47ca-a5f3-0124fde95ece service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:04.465249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52648d85-c5e2-47ca-a5f3-0124fde95ece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:04.474905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52648d85-c5e2-47ca-a5f3-0124fde95ece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:04.476348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52648d85-c5e2-47ca-a5f3-0124fde95ece service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:04.486218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 678/1377] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:04.622585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccff67-1f33-476e-942d-e006759c6f87 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:04.622872 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccff67-1f33-476e-942d-e006759c6f87 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:04.623356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccff67-1f33-476e-942d-e006759c6f87 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:04.625134 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 700/1378] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:02:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:04.632123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfe3c4-8241-40d8-8319-393405a3af7b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:04.632417 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfe3c4-8241-40d8-8319-393405a3af7b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:04.632751 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfe3c4-8241-40d8-8319-393405a3af7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:04.654220 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-9ccfe3c4-8241-40d8-8319-393405a3af7b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:04.655465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9ccfe3c4-8241-40d8-8319-393405a3af7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:04.665087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 679/1379] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:02:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:04.714108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccff67-1f33-476e-942d-e006759c6f87 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:04.728010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccff67-1f33-476e-942d-e006759c6f87 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:04.733525 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966b182-94ba-469e-9103-fa66db6e9e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:04.734099 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966b182-94ba-469e-9103-fa66db6e9e7a service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:04.734393 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966b182-94ba-469e-9103-fa66db6e9e7a service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:04.734678 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966b182-94ba-469e-9103-fa66db6e9e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:04.743251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966b182-94ba-469e-9103-fa66db6e9e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:04.744816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966b182-94ba-469e-9103-fa66db6e9e7a service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:04.754437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 701/1380] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:07.143336 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971acea3-c156-463a-b7a4-d91ff3f9e5a6 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:07.143835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971acea3-c156-463a-b7a4-d91ff3f9e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:07.143835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971acea3-c156-463a-b7a4-d91ff3f9e5a6 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:07.146474 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 680/1381] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:02:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:07.152478 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eb0f0-8286-40de-a102-f26c33e83377 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:07.152914 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eb0f0-8286-40de-a102-f26c33e83377 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:07.153037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eb0f0-8286-40de-a102-f26c33e83377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:07.170428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-6d8eb0f0-8286-40de-a102-f26c33e83377 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:07.171616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6d8eb0f0-8286-40de-a102-f26c33e83377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:07.180012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 702/1382] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:02:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:07.225383 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971acea3-c156-463a-b7a4-d91ff3f9e5a6 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:07.240576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971acea3-c156-463a-b7a4-d91ff3f9e5a6 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:07.245920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab5de9-a5c0-4538-bc10-9f72eb23ccbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:07.246576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab5de9-a5c0-4538-bc10-9f72eb23ccbe service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:07.246863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab5de9-a5c0-4538-bc10-9f72eb23ccbe service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:07.247138 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab5de9-a5c0-4538-bc10-9f72eb23ccbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:07.255972 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab5de9-a5c0-4538-bc10-9f72eb23ccbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:07.257535 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab5de9-a5c0-4538-bc10-9f72eb23ccbe service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:07.266625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 681/1383] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:09.749568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecf505-7ee5-4778-9302-8f876cb131d1 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:09.750109 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecf505-7ee5-4778-9302-8f876cb131d1 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:09.750109 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecf505-7ee5-4778-9302-8f876cb131d1 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:09.751818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 703/1384] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:02:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:09.757783 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64b5fc-ce61-4575-8aa8-13260afd6047 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:09.758281 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64b5fc-ce61-4575-8aa8-13260afd6047 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:09.758399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64b5fc-ce61-4575-8aa8-13260afd6047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:09.775973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-0b64b5fc-ce61-4575-8aa8-13260afd6047 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:09.777148 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0b64b5fc-ce61-4575-8aa8-13260afd6047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:09.784784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 682/1385] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:02:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:09.831430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecf505-7ee5-4778-9302-8f876cb131d1 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:09.852673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecf505-7ee5-4778-9302-8f876cb131d1 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:09.858930 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf59019-6bd6-4aa2-9c9c-5d0cfbbe8f97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:09.859639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf59019-6bd6-4aa2-9c9c-5d0cfbbe8f97 service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:09.859989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf59019-6bd6-4aa2-9c9c-5d0cfbbe8f97 service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:09.860333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf59019-6bd6-4aa2-9c9c-5d0cfbbe8f97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:09.870209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf59019-6bd6-4aa2-9c9c-5d0cfbbe8f97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:09.871853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf59019-6bd6-4aa2-9c9c-5d0cfbbe8f97 service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:09.881346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 704/1386] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:12.307364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d405c-3489-4388-9356-a5905beedfa0 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:12.307925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d405c-3489-4388-9356-a5905beedfa0 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:12.307925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d405c-3489-4388-9356-a5905beedfa0 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:12.309661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 683/1387] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:02:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:12.315461 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e437e6-41c2-4772-bfea-d0d0d8b0819b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:12.315870 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e437e6-41c2-4772-bfea-d0d0d8b0819b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:12.316009 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e437e6-41c2-4772-bfea-d0d0d8b0819b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:12.335043 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e2e437e6-41c2-4772-bfea-d0d0d8b0819b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:12.336233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e2e437e6-41c2-4772-bfea-d0d0d8b0819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:12.343924 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 705/1388] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:02:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:12.392607 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d405c-3489-4388-9356-a5905beedfa0 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:12.407509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d405c-3489-4388-9356-a5905beedfa0 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:12.413785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704e6d1-25e8-44b0-9dc4-ee76c324198c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:12.414479 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704e6d1-25e8-44b0-9dc4-ee76c324198c service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:12.414760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704e6d1-25e8-44b0-9dc4-ee76c324198c service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:12.415034 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704e6d1-25e8-44b0-9dc4-ee76c324198c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:12.424650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704e6d1-25e8-44b0-9dc4-ee76c324198c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:12.426880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704e6d1-25e8-44b0-9dc4-ee76c324198c service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:12.436733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 684/1389] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:14.808696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bacce-4201-4bd5-bd64-a3c84b5fd8a4 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:14.809551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bacce-4201-4bd5-bd64-a3c84b5fd8a4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:14.809771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bacce-4201-4bd5-bd64-a3c84b5fd8a4 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:14.813211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 706/1390] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:02:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:14.820763 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3ee5a-b097-4e98-805c-7d42e717790b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:14.821274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3ee5a-b097-4e98-805c-7d42e717790b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:14.821366 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3ee5a-b097-4e98-805c-7d42e717790b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:14.840589 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-96c3ee5a-b097-4e98-805c-7d42e717790b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:14.841788 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-96c3ee5a-b097-4e98-805c-7d42e717790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:14.851323 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 685/1391] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:02:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:14.899794 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bacce-4201-4bd5-bd64-a3c84b5fd8a4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:14.924625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bacce-4201-4bd5-bd64-a3c84b5fd8a4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:14.934517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8776c48-8a3a-4c30-a777-d70fd9ff5d60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:14.935632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8776c48-8a3a-4c30-a777-d70fd9ff5d60 service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:14.936145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8776c48-8a3a-4c30-a777-d70fd9ff5d60 service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:14.936634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8776c48-8a3a-4c30-a777-d70fd9ff5d60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:14.951941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8776c48-8a3a-4c30-a777-d70fd9ff5d60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:14.954965 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8776c48-8a3a-4c30-a777-d70fd9ff5d60 service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:14.972930 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 707/1392] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:17.709920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ca85d-673b-4dd1-8ab7-7cdd698ae6ca None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:17.710509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ca85d-673b-4dd1-8ab7-7cdd698ae6ca None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:17.710608 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ca85d-673b-4dd1-8ab7-7cdd698ae6ca None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:17.712373 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 686/1393] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:02:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:17.718033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b92566-42ad-42a3-899d-5e054985f8d5 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:17.718440 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b92566-42ad-42a3-899d-5e054985f8d5 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:17.718629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b92566-42ad-42a3-899d-5e054985f8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:17.736644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-61b92566-42ad-42a3-899d-5e054985f8d5 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:17.738538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-61b92566-42ad-42a3-899d-5e054985f8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:17.746497 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 708/1394] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:02:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:17.792853 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ca85d-673b-4dd1-8ab7-7cdd698ae6ca None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:17.807204 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ca85d-673b-4dd1-8ab7-7cdd698ae6ca None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:17.812420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec5bda-06a5-40c3-9d58-1abe02043b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:17.813039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec5bda-06a5-40c3-9d58-1abe02043b97 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:17.813318 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec5bda-06a5-40c3-9d58-1abe02043b97 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:17.813598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec5bda-06a5-40c3-9d58-1abe02043b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:17.822516 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec5bda-06a5-40c3-9d58-1abe02043b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:17.824071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec5bda-06a5-40c3-9d58-1abe02043b97 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:17.833735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 687/1395] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:19.688023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ff89d-4842-4e9e-bb62-24d30a138bfe None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:19.688608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ff89d-4842-4e9e-bb62-24d30a138bfe None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:19.688608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ff89d-4842-4e9e-bb62-24d30a138bfe None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:19.690335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 709/1396] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:02:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:19.696697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661a3f5-f354-45d3-9ab9-c2d11cfea098 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:19.697149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661a3f5-f354-45d3-9ab9-c2d11cfea098 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:19.697251 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661a3f5-f354-45d3-9ab9-c2d11cfea098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:19.715090 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e661a3f5-f354-45d3-9ab9-c2d11cfea098 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:19.716407 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e661a3f5-f354-45d3-9ab9-c2d11cfea098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:19.724070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 688/1397] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:02:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:19.782647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f66b3d-3d5e-4ee2-8adc-644967e1fd40 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:19.782935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f66b3d-3d5e-4ee2-8adc-644967e1fd40 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:19.783216 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f66b3d-3d5e-4ee2-8adc-644967e1fd40 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:19.784975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 710/1398] 10.222.0.23 () {54 vars in 962 bytes} [Thu Dec 9 01:02:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:19.790691 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaf645-c233-46ba-936d-88d09f00904e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:19.791100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaf645-c233-46ba-936d-88d09f00904e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:19.791388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaf645-c233-46ba-936d-88d09f00904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:19.844848 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-54aaf645-c233-46ba-936d-88d09f00904e None None] MFA Rules not processed for user `3d001733477f499e937ba90e7e50ba33`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:19.846056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-54aaf645-c233-46ba-936d-88d09f00904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:19.904815 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 689/1399] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Dec 9 01:02:19 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:02:19.913625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f66b3d-3d5e-4ee2-8adc-644967e1fd40 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:19.924253 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f66b3d-3d5e-4ee2-8adc-644967e1fd40 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:19.928761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96736373-bd14-477a-8b2e-cd0e2ed2b8fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d001733477f499e937ba90e7e50ba33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:19.929440 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96736373-bd14-477a-8b2e-cd0e2ed2b8fc service glance] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:19.929682 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96736373-bd14-477a-8b2e-cd0e2ed2b8fc service glance] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:19.929955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96736373-bd14-477a-8b2e-cd0e2ed2b8fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:19.940444 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96736373-bd14-477a-8b2e-cd0e2ed2b8fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:19.942493 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96736373-bd14-477a-8b2e-cd0e2ed2b8fc service glance] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:19.951753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 711/1400] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:20.240414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09a028-c282-44b6-9e5b-331aff9a828a None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:20.240631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09a028-c282-44b6-9e5b-331aff9a828a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:20.240890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09a028-c282-44b6-9e5b-331aff9a828a None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:20.242750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 690/1401] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:02:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:20.248980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ea3ca-10ba-4b22-8d53-98a018a566ad None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:20.249263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ea3ca-10ba-4b22-8d53-98a018a566ad None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:20.249539 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ea3ca-10ba-4b22-8d53-98a018a566ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:20.269680 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-b03ea3ca-10ba-4b22-8d53-98a018a566ad None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:20.271071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b03ea3ca-10ba-4b22-8d53-98a018a566ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:20.278967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 712/1402] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:02:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:20.330583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09a028-c282-44b6-9e5b-331aff9a828a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:20.346061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09a028-c282-44b6-9e5b-331aff9a828a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:20.353491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30655d2-d6aa-4b67-9d51-6bcd6ff9b6b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:20.354505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30655d2-d6aa-4b67-9d51-6bcd6ff9b6b3 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:20.354793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30655d2-d6aa-4b67-9d51-6bcd6ff9b6b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:20.355242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30655d2-d6aa-4b67-9d51-6bcd6ff9b6b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:20.367114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30655d2-d6aa-4b67-9d51-6bcd6ff9b6b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:20.369176 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30655d2-d6aa-4b67-9d51-6bcd6ff9b6b3 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:20.381238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 691/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:20.471555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a425fc-00b9-433c-ac57-6b6d567bbf64 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:20.472002 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a425fc-00b9-433c-ac57-6b6d567bbf64 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:20.472195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a425fc-00b9-433c-ac57-6b6d567bbf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:20.536443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-10a425fc-00b9-433c-ac57-6b6d567bbf64 None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:20.537704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-10a425fc-00b9-433c-ac57-6b6d567bbf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:20.623476 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 713/1404] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:02:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:20.674106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e226a-0172-4b80-a385-110a3127434d None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:20.674424 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e226a-0172-4b80-a385-110a3127434d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:20.674706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e226a-0172-4b80-a385-110a3127434d None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:20.677359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 692/1405] 10.222.0.23 () {54 vars in 942 bytes} [Thu Dec 9 01:02:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:20.685147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fbe06-acf3-44a4-84a9-e171490fb45b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:20.685441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fbe06-acf3-44a4-84a9-e171490fb45b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:20.685717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fbe06-acf3-44a4-84a9-e171490fb45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:20.749757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-6f9fbe06-acf3-44a4-84a9-e171490fb45b None None] MFA Rules not processed for user `f2a17190105a4228bdd94926e1a2091e`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:20.751007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6f9fbe06-acf3-44a4-84a9-e171490fb45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:20.845079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 714/1406] 10.222.0.23 () {58 vars in 1039 bytes} [Thu Dec 9 01:02:20 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:20.861863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e226a-0172-4b80-a385-110a3127434d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:20.877173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e226a-0172-4b80-a385-110a3127434d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:20.883388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3405ed-d8fa-4319-9c82-f94e404b617c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:20.884032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3405ed-d8fa-4319-9c82-f94e404b617c service swift] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:20.884317 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3405ed-d8fa-4319-9c82-f94e404b617c service swift] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:20.884597 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3405ed-d8fa-4319-9c82-f94e404b617c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:20.893883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3405ed-d8fa-4319-9c82-f94e404b617c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:20.896084 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3405ed-d8fa-4319-9c82-f94e404b617c service swift] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:20.905801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 693/1407] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:02:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 01:02:22.866323 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01bedd-2e9c-4b9e-85fc-8cd25052d19f None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:22.866823 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01bedd-2e9c-4b9e-85fc-8cd25052d19f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:22.866906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01bedd-2e9c-4b9e-85fc-8cd25052d19f None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:22.868768 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 715/1408] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:02:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:22.874590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f1dac-dfde-4f03-8fbb-e0edb477a727 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:22.875013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f1dac-dfde-4f03-8fbb-e0edb477a727 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:22.875151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f1dac-dfde-4f03-8fbb-e0edb477a727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:22.893699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-8f9f1dac-dfde-4f03-8fbb-e0edb477a727 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:22.894997 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8f9f1dac-dfde-4f03-8fbb-e0edb477a727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:22.902848 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 694/1409] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:02:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:22.951138 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01bedd-2e9c-4b9e-85fc-8cd25052d19f None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:22.966936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01bedd-2e9c-4b9e-85fc-8cd25052d19f None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:22.972324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3068-d8b3-4ec6-85ba-5766cdc9ddde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:22.972988 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3068-d8b3-4ec6-85ba-5766cdc9ddde service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:22.973263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3068-d8b3-4ec6-85ba-5766cdc9ddde service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:22.973536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3068-d8b3-4ec6-85ba-5766cdc9ddde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:22.986100 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a3068-d8b3-4ec6-85ba-5766cdc9ddde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:22.988295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a3068-d8b3-4ec6-85ba-5766cdc9ddde service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:22.998414 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 716/1410] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:25.485113 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbacfd5-44a3-4709-be13-2093fecd2094 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:25.485113 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbacfd5-44a3-4709-be13-2093fecd2094 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:25.485113 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbacfd5-44a3-4709-be13-2093fecd2094 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:25.486245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 695/1411] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:02:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:25.493058 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e125a-3ab1-4a0d-a231-75ddf9c25001 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:25.493500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e125a-3ab1-4a0d-a231-75ddf9c25001 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:25.493742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e125a-3ab1-4a0d-a231-75ddf9c25001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:25.513019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-0e0e125a-3ab1-4a0d-a231-75ddf9c25001 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:25.514252 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0e0e125a-3ab1-4a0d-a231-75ddf9c25001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:25.523877 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 717/1412] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:02:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:02:25.571923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbacfd5-44a3-4709-be13-2093fecd2094 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:25.585909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbacfd5-44a3-4709-be13-2093fecd2094 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:25.591492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe44a57-06c3-48df-9dd8-2c1e6dba6239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:25.592121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe44a57-06c3-48df-9dd8-2c1e6dba6239 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:25.592402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe44a57-06c3-48df-9dd8-2c1e6dba6239 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:25.592681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe44a57-06c3-48df-9dd8-2c1e6dba6239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:25.601689 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe44a57-06c3-48df-9dd8-2c1e6dba6239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:25.603291 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe44a57-06c3-48df-9dd8-2c1e6dba6239 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:25.613895 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 696/1413] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:44.132262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4659-5267-412f-be33-e4f185652c98 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:44.132793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4659-5267-412f-be33-e4f185652c98 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:44.132793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4659-5267-412f-be33-e4f185652c98 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:44.134507 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 718/1414] 10.222.0.23 () {54 vars in 918 bytes} [Thu Dec 9 01:02:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:44.140221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359bf79-34ea-46e0-968b-8ed164286b65 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:44.140774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359bf79-34ea-46e0-968b-8ed164286b65 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:44.140774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359bf79-34ea-46e0-968b-8ed164286b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:44.160039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-7359bf79-34ea-46e0-968b-8ed164286b65 None None] MFA Rules not processed for user `a2cebb33ff7c4e40a06b3c7f1a40823d`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:44.161279 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7359bf79-34ea-46e0-968b-8ed164286b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:44.169538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 697/1415] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Dec 9 01:02:44 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:44.184817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f71311-abd4-4a92-b0f5-a5bbf5729f8e None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:44.185105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f71311-abd4-4a92-b0f5-a5bbf5729f8e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:44.185383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f71311-abd4-4a92-b0f5-a5bbf5729f8e None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:44.187183 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 719/1416] 10.222.0.23 () {54 vars in 918 bytes} [Thu Dec 9 01:02:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:44.192586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf87840-a437-4b85-bcc3-0bae7aff44d2 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:44.192869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf87840-a437-4b85-bcc3-0bae7aff44d2 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:44.193163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf87840-a437-4b85-bcc3-0bae7aff44d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:44.210806 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-7cf87840-a437-4b85-bcc3-0bae7aff44d2 None None] MFA Rules not processed for user `53d32ba063bc4a719d4c2f67d88ec640`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:44.211979 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7cf87840-a437-4b85-bcc3-0bae7aff44d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:44.220653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 698/1417] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Dec 9 01:02:44 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:46.942922 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066d0ba-a2f0-4f2b-9d6a-861bad2db776 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:46.943470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066d0ba-a2f0-4f2b-9d6a-861bad2db776 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:46.943584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066d0ba-a2f0-4f2b-9d6a-861bad2db776 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:46.945359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 720/1418] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:02:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:46.951202 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc55b71-f067-474c-b49a-3825480572e8 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:46.951601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc55b71-f067-474c-b49a-3825480572e8 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:46.951740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc55b71-f067-474c-b49a-3825480572e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:46.969612 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-ebc55b71-f067-474c-b49a-3825480572e8 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:46.970814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ebc55b71-f067-474c-b49a-3825480572e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:46.979837 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 699/1419] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:02:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:47.022843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066d0ba-a2f0-4f2b-9d6a-861bad2db776 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:47.037605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066d0ba-a2f0-4f2b-9d6a-861bad2db776 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:47.042828 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbb1e8-420a-4d21-931e-fb182441af9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:47.043445 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb1e8-420a-4d21-931e-fb182441af9a service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:47.043749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb1e8-420a-4d21-931e-fb182441af9a service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:47.044020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb1e8-420a-4d21-931e-fb182441af9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:47.052178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbb1e8-420a-4d21-931e-fb182441af9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:47.053728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbb1e8-420a-4d21-931e-fb182441af9a service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:47.062688 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 721/1420] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:48.656328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c8b5-1ec4-4085-99eb-4c82cbc52b9f None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:48.656864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c8b5-1ec4-4085-99eb-4c82cbc52b9f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:48.656864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c8b5-1ec4-4085-99eb-4c82cbc52b9f None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:48.659173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 700/1421] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 9 01:02:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:48.664884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfb362-5fcb-4450-8fb4-9aab5ea3170b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:48.665303 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfb362-5fcb-4450-8fb4-9aab5ea3170b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:48.665427 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfb362-5fcb-4450-8fb4-9aab5ea3170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:48.683535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e7bfb362-5fcb-4450-8fb4-9aab5ea3170b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:48.684714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e7bfb362-5fcb-4450-8fb4-9aab5ea3170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:48.692427 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 722/1422] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 9 01:02:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:48.844178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033c8b5-1ec4-4085-99eb-4c82cbc52b9f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:48.859121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033c8b5-1ec4-4085-99eb-4c82cbc52b9f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:48.865006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6df9f9-ac01-4fb6-8235-3a8c6efc8016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:48.865631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6df9f9-ac01-4fb6-8235-3a8c6efc8016 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:48.865908 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6df9f9-ac01-4fb6-8235-3a8c6efc8016 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:48.866178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6df9f9-ac01-4fb6-8235-3a8c6efc8016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:48.874035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6df9f9-ac01-4fb6-8235-3a8c6efc8016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:48.875634 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6df9f9-ac01-4fb6-8235-3a8c6efc8016 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:48.885079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 701/1423] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:50.417131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e95612-74a6-4a26-93bf-4aadd2e60aeb None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:50.417697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e95612-74a6-4a26-93bf-4aadd2e60aeb None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:50.417697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e95612-74a6-4a26-93bf-4aadd2e60aeb None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:50.419469 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 723/1424] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 9 01:02:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:50.425389 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe1ce-f558-4e92-a63e-404fd496c284 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:50.425849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe1ce-f558-4e92-a63e-404fd496c284 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:50.426032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe1ce-f558-4e92-a63e-404fd496c284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:50.445268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-059fe1ce-f558-4e92-a63e-404fd496c284 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:50.446495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-059fe1ce-f558-4e92-a63e-404fd496c284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:50.454063 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 702/1425] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 9 01:02:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:50.606574 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e95612-74a6-4a26-93bf-4aadd2e60aeb None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:50.620750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e95612-74a6-4a26-93bf-4aadd2e60aeb None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:50.625980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0257730-449a-499d-aeb2-3287561bb040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:50.626630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0257730-449a-499d-aeb2-3287561bb040 service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:50.626904 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0257730-449a-499d-aeb2-3287561bb040 service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:50.627174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0257730-449a-499d-aeb2-3287561bb040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:50.635634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0257730-449a-499d-aeb2-3287561bb040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:50.637195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0257730-449a-499d-aeb2-3287561bb040 service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:50.646918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 724/1426] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:52.184822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38833c9b-637e-4c4a-90ef-e2b7694915df None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:52.185335 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38833c9b-637e-4c4a-90ef-e2b7694915df None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:52.185335 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38833c9b-637e-4c4a-90ef-e2b7694915df None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:52.187116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 703/1427] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 9 01:02:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:52.193430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93e9c-8ded-4765-bd45-4f3396ec7273 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:52.193816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93e9c-8ded-4765-bd45-4f3396ec7273 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:52.194016 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93e9c-8ded-4765-bd45-4f3396ec7273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:52.211822 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-96b93e9c-8ded-4765-bd45-4f3396ec7273 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:52.213007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-96b93e9c-8ded-4765-bd45-4f3396ec7273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:52.220664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 725/1428] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 9 01:02:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:52.379616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38833c9b-637e-4c4a-90ef-e2b7694915df None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:52.393348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38833c9b-637e-4c4a-90ef-e2b7694915df None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:52.398656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d156f81-b090-4715-853a-4367870e642f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:52.399272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d156f81-b090-4715-853a-4367870e642f service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:52.399551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d156f81-b090-4715-853a-4367870e642f service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:52.399820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d156f81-b090-4715-853a-4367870e642f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:52.407634 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d156f81-b090-4715-853a-4367870e642f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:52.409951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d156f81-b090-4715-853a-4367870e642f service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:52.418943 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 704/1429] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:53.969304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f65fa9-9919-432c-9bae-a59168c6fa26 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:53.969717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f65fa9-9919-432c-9bae-a59168c6fa26 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:53.969874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f65fa9-9919-432c-9bae-a59168c6fa26 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:53.972237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 726/1430] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 9 01:02:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:53.977592 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989eca8-6abc-4dd8-abd1-f7c9aa141e9d None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:53.978005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989eca8-6abc-4dd8-abd1-f7c9aa141e9d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:53.978165 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989eca8-6abc-4dd8-abd1-f7c9aa141e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:53.995842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b989eca8-6abc-4dd8-abd1-f7c9aa141e9d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:53.997049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b989eca8-6abc-4dd8-abd1-f7c9aa141e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:54.005423 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 705/1431] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 9 01:02:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:54.158942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f65fa9-9919-432c-9bae-a59168c6fa26 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:54.172938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f65fa9-9919-432c-9bae-a59168c6fa26 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:54.181470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd173267-b942-462e-9304-32bda745b5f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:54.182135 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173267-b942-462e-9304-32bda745b5f8 service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:54.182452 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173267-b942-462e-9304-32bda745b5f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:54.182739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173267-b942-462e-9304-32bda745b5f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:54.191545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd173267-b942-462e-9304-32bda745b5f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:54.193116 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd173267-b942-462e-9304-32bda745b5f8 service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:54.202345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 727/1432] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:55.696320 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc934e22-f9c3-49fc-aeea-9c52fda18e2b None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:55.696905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc934e22-f9c3-49fc-aeea-9c52fda18e2b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:55.696905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc934e22-f9c3-49fc-aeea-9c52fda18e2b None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:55.698685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 706/1433] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 9 01:02:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:55.704150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729967d-6bd7-4d55-9370-6b65eea59d0c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:55.704559 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729967d-6bd7-4d55-9370-6b65eea59d0c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:55.704707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729967d-6bd7-4d55-9370-6b65eea59d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:55.724186 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2729967d-6bd7-4d55-9370-6b65eea59d0c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:55.725370 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2729967d-6bd7-4d55-9370-6b65eea59d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:55.733215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 728/1434] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 9 01:02:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:55.889473 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc934e22-f9c3-49fc-aeea-9c52fda18e2b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:55.907208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc934e22-f9c3-49fc-aeea-9c52fda18e2b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:55.913705 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a081b-3da1-4ff4-92da-47f266a5911b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:55.914334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a081b-3da1-4ff4-92da-47f266a5911b service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:55.914638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a081b-3da1-4ff4-92da-47f266a5911b service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:55.914910 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a081b-3da1-4ff4-92da-47f266a5911b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:55.923000 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a081b-3da1-4ff4-92da-47f266a5911b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:55.925095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a081b-3da1-4ff4-92da-47f266a5911b service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:55.934178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 707/1435] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:57.407314 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82964f4-8710-4c3d-be48-4acb7b8d7a62 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:57.407876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82964f4-8710-4c3d-be48-4acb7b8d7a62 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:57.407876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82964f4-8710-4c3d-be48-4acb7b8d7a62 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:57.410431 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 729/1436] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 9 01:02:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:57.415828 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8e16-e04d-4a04-864d-bbcaa6fac637 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:57.416259 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8e16-e04d-4a04-864d-bbcaa6fac637 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:57.416370 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8e16-e04d-4a04-864d-bbcaa6fac637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:57.433732 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-724b8e16-e04d-4a04-864d-bbcaa6fac637 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:57.434938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-724b8e16-e04d-4a04-864d-bbcaa6fac637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:57.442557 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 708/1437] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 9 01:02:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:57.594398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82964f4-8710-4c3d-be48-4acb7b8d7a62 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:57.608715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82964f4-8710-4c3d-be48-4acb7b8d7a62 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:57.614248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f6510-5da9-4fd5-85c0-2dd6a0ec5a95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:57.614907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f6510-5da9-4fd5-85c0-2dd6a0ec5a95 service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:57.615295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f6510-5da9-4fd5-85c0-2dd6a0ec5a95 service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:57.615571 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f6510-5da9-4fd5-85c0-2dd6a0ec5a95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:57.623532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f6510-5da9-4fd5-85c0-2dd6a0ec5a95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:57.625092 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f6510-5da9-4fd5-85c0-2dd6a0ec5a95 service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:57.634839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 730/1438] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:59.103095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367711c3-f635-40ff-853d-ab66faaab30e None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:59.103904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367711c3-f635-40ff-853d-ab66faaab30e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:59.103904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367711c3-f635-40ff-853d-ab66faaab30e None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:59.105641 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 709/1439] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 9 01:02:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:02:59.111171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815a00d-b22e-46b3-b848-8365bfa973d6 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:59.111595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815a00d-b22e-46b3-b848-8365bfa973d6 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:59.111919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815a00d-b22e-46b3-b848-8365bfa973d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:59.130069 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-7815a00d-b22e-46b3-b848-8365bfa973d6 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:02:59.131285 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-7815a00d-b22e-46b3-b848-8365bfa973d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:02:59.138989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 731/1440] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 9 01:02:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:02:59.291273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367711c3-f635-40ff-853d-ab66faaab30e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:02:59.305844 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367711c3-f635-40ff-853d-ab66faaab30e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:02:59.311166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de594a41-7b9a-42f6-9a17-3fb788c8a581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:02:59.311789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de594a41-7b9a-42f6-9a17-3fb788c8a581 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:02:59.312074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de594a41-7b9a-42f6-9a17-3fb788c8a581 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:02:59.312351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de594a41-7b9a-42f6-9a17-3fb788c8a581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:02:59.320360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de594a41-7b9a-42f6-9a17-3fb788c8a581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:02:59.321925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de594a41-7b9a-42f6-9a17-3fb788c8a581 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:02:59.331251 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 710/1441] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:02:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:00.811921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143d73e-963f-4b39-b619-851875252d9d None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:00.812509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143d73e-963f-4b39-b619-851875252d9d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:00.812509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143d73e-963f-4b39-b619-851875252d9d None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:00.814240 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 732/1442] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 9 01:03:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:00.820297 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf61cc-9488-4e6d-9ff3-03188e31c329 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:00.820779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf61cc-9488-4e6d-9ff3-03188e31c329 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:00.820886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf61cc-9488-4e6d-9ff3-03188e31c329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:00.839129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-6cdf61cc-9488-4e6d-9ff3-03188e31c329 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:00.840337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-6cdf61cc-9488-4e6d-9ff3-03188e31c329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:00.848246 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 711/1443] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 9 01:03:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:03:01.000130 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143d73e-963f-4b39-b619-851875252d9d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:01.014696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143d73e-963f-4b39-b619-851875252d9d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:01.019962 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020260a3-3f2b-425d-bdd8-5c18691b1f3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:01.020577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020260a3-3f2b-425d-bdd8-5c18691b1f3a service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:01.020852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020260a3-3f2b-425d-bdd8-5c18691b1f3a service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:01.021126 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020260a3-3f2b-425d-bdd8-5c18691b1f3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:01.029028 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020260a3-3f2b-425d-bdd8-5c18691b1f3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:01.030603 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020260a3-3f2b-425d-bdd8-5c18691b1f3a service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:01.039666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 733/1444] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:03.285459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618f3b7-7f3f-4e6f-907b-bee30656be61 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:03.286010 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618f3b7-7f3f-4e6f-907b-bee30656be61 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:03.286127 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618f3b7-7f3f-4e6f-907b-bee30656be61 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:03.287919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 712/1445] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:03:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:03.293825 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128329b3-4b4e-42ac-96e8-19c4061203ee None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:03.294228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128329b3-4b4e-42ac-96e8-19c4061203ee None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:03.294420 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128329b3-4b4e-42ac-96e8-19c4061203ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:03.312998 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-128329b3-4b4e-42ac-96e8-19c4061203ee None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:03.314182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-128329b3-4b4e-42ac-96e8-19c4061203ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:03.322999 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 734/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:03:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:03.362704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618f3b7-7f3f-4e6f-907b-bee30656be61 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:03.372996 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618f3b7-7f3f-4e6f-907b-bee30656be61 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:03.376443 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b52b21-184c-48bc-89c9-0dfb51d2336f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:03.377730 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b52b21-184c-48bc-89c9-0dfb51d2336f service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:03.377982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b52b21-184c-48bc-89c9-0dfb51d2336f service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:03.378259 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b52b21-184c-48bc-89c9-0dfb51d2336f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:03.386828 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b52b21-184c-48bc-89c9-0dfb51d2336f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:03.388238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b52b21-184c-48bc-89c9-0dfb51d2336f service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:03.397577 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 713/1447] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:05.892629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6e0b-274e-4e7b-a7f0-1a59bc4c78a3 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:05.893145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6e0b-274e-4e7b-a7f0-1a59bc4c78a3 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:05.893241 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6e0b-274e-4e7b-a7f0-1a59bc4c78a3 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:05.895055 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 735/1448] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:03:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:05.900795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203552e-e6af-4af1-9f08-ecfe9efd7e63 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:05.901172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203552e-e6af-4af1-9f08-ecfe9efd7e63 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:05.901344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203552e-e6af-4af1-9f08-ecfe9efd7e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:05.919254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-f203552e-e6af-4af1-9f08-ecfe9efd7e63 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:05.920444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f203552e-e6af-4af1-9f08-ecfe9efd7e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:05.928807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 714/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:03:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:05.967392 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a6e0b-274e-4e7b-a7f0-1a59bc4c78a3 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:05.978823 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a6e0b-274e-4e7b-a7f0-1a59bc4c78a3 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:05.982306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d34f0-d8f4-4e20-820e-9f2b278b439f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:05.982956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d34f0-d8f4-4e20-820e-9f2b278b439f service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:05.983243 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d34f0-d8f4-4e20-820e-9f2b278b439f service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:05.983523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d34f0-d8f4-4e20-820e-9f2b278b439f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:05.992906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d34f0-d8f4-4e20-820e-9f2b278b439f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:05.994319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d34f0-d8f4-4e20-820e-9f2b278b439f service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:06.003565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 736/1450] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:08.680733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f33c0-fd77-44c2-971e-098d5421964d None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:08.681533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f33c0-fd77-44c2-971e-098d5421964d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:08.681533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f33c0-fd77-44c2-971e-098d5421964d None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:08.683067 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 715/1451] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:03:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:08.689165 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cf979-088f-4d91-a1da-1121c32bc6d6 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:08.690162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cf979-088f-4d91-a1da-1121c32bc6d6 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:08.690162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cf979-088f-4d91-a1da-1121c32bc6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:08.708079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9d8cf979-088f-4d91-a1da-1121c32bc6d6 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:08.709263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9d8cf979-088f-4d91-a1da-1121c32bc6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:08.716890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 737/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:03:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:03:08.758588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f33c0-fd77-44c2-971e-098d5421964d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:08.769663 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f33c0-fd77-44c2-971e-098d5421964d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:08.773129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa441a2e-cfeb-436e-b36d-8b8823e20e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:08.773750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa441a2e-cfeb-436e-b36d-8b8823e20e14 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:08.774032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa441a2e-cfeb-436e-b36d-8b8823e20e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:08.774308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa441a2e-cfeb-436e-b36d-8b8823e20e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:08.782903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa441a2e-cfeb-436e-b36d-8b8823e20e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:08.785018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa441a2e-cfeb-436e-b36d-8b8823e20e14 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:08.794049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 716/1453] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:11.293607 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c655257-06eb-4aeb-8c94-75572df3e0c3 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:11.294148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c655257-06eb-4aeb-8c94-75572df3e0c3 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:11.294148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c655257-06eb-4aeb-8c94-75572df3e0c3 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:11.296843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 738/1454] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:03:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:11.303225 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07177e2-7f1b-49ff-9f04-ce55cfe0397b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:11.303812 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07177e2-7f1b-49ff-9f04-ce55cfe0397b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:11.303812 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07177e2-7f1b-49ff-9f04-ce55cfe0397b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:11.321779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-f07177e2-7f1b-49ff-9f04-ce55cfe0397b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:11.322996 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f07177e2-7f1b-49ff-9f04-ce55cfe0397b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:11.331397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 717/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:03:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:03:11.371320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c655257-06eb-4aeb-8c94-75572df3e0c3 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:11.382823 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c655257-06eb-4aeb-8c94-75572df3e0c3 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:11.386208 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b18b6-4138-4a5f-b2e7-dd1ab050b8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:11.386870 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b18b6-4138-4a5f-b2e7-dd1ab050b8af service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:11.387148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b18b6-4138-4a5f-b2e7-dd1ab050b8af service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:11.387417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b18b6-4138-4a5f-b2e7-dd1ab050b8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:11.396462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b18b6-4138-4a5f-b2e7-dd1ab050b8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:11.397884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b18b6-4138-4a5f-b2e7-dd1ab050b8af service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:11.406833 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 739/1456] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:03:13.831707 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b3028-ec06-466f-b9e8-597aaf661ac2 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:13.832274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b3028-ec06-466f-b9e8-597aaf661ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:13.832274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b3028-ec06-466f-b9e8-597aaf661ac2 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:13.834054 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 718/1457] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:03:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:13.839834 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adebef-fb52-493d-a641-13eac0fa3669 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:13.840271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adebef-fb52-493d-a641-13eac0fa3669 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:13.840417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adebef-fb52-493d-a641-13eac0fa3669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:13.858336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-45adebef-fb52-493d-a641-13eac0fa3669 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:13.859552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-45adebef-fb52-493d-a641-13eac0fa3669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:13.867781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 740/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:03:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:03:13.907284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b3028-ec06-466f-b9e8-597aaf661ac2 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:13.917865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b3028-ec06-466f-b9e8-597aaf661ac2 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:13.921516 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd034a79-2373-4380-9aa9-9d92bb3f7e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:13.922143 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd034a79-2373-4380-9aa9-9d92bb3f7e2f service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:13.922457 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd034a79-2373-4380-9aa9-9d92bb3f7e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:13.922735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd034a79-2373-4380-9aa9-9d92bb3f7e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:13.931923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd034a79-2373-4380-9aa9-9d92bb3f7e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:13.933340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd034a79-2373-4380-9aa9-9d92bb3f7e2f service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:13.943146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 719/1459] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:16.359467 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462db723-d41a-4851-9906-a054f8218458 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:16.359994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462db723-d41a-4851-9906-a054f8218458 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:16.359994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462db723-d41a-4851-9906-a054f8218458 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:16.362275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 741/1460] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:03:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:16.368245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04326174-5b30-4d81-83ac-2f731d3cfcd4 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:16.368660 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04326174-5b30-4d81-83ac-2f731d3cfcd4 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:16.368796 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04326174-5b30-4d81-83ac-2f731d3cfcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:16.386152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-04326174-5b30-4d81-83ac-2f731d3cfcd4 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:16.387380 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-04326174-5b30-4d81-83ac-2f731d3cfcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:16.395147 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 720/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:03:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:16.435208 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462db723-d41a-4851-9906-a054f8218458 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:16.445679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462db723-d41a-4851-9906-a054f8218458 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:16.449091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15708a-c55f-4f41-8610-8df81f36dfd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:16.449704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15708a-c55f-4f41-8610-8df81f36dfd5 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:16.449978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15708a-c55f-4f41-8610-8df81f36dfd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:16.450246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15708a-c55f-4f41-8610-8df81f36dfd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:16.458758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15708a-c55f-4f41-8610-8df81f36dfd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:16.460163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15708a-c55f-4f41-8610-8df81f36dfd5 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:16.469374 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 742/1462] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:18.903913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f1e3f-aa27-4a80-80b4-76f88db89c65 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:18.904416 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f1e3f-aa27-4a80-80b4-76f88db89c65 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:18.904514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f1e3f-aa27-4a80-80b4-76f88db89c65 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:18.906234 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 721/1463] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:03:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:18.913018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7c55-87b3-416d-adf3-5a7a18a54932 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:18.913434 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7c55-87b3-416d-adf3-5a7a18a54932 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:18.913590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7c55-87b3-416d-adf3-5a7a18a54932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:18.931550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-eefe7c55-87b3-416d-adf3-5a7a18a54932 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:18.932718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-eefe7c55-87b3-416d-adf3-5a7a18a54932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:18.940218 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 743/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:03:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:18.980868 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f1e3f-aa27-4a80-80b4-76f88db89c65 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:18.982555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-810f1e3f-aa27-4a80-80b4-76f88db89c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:18.995767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f1e3f-aa27-4a80-80b4-76f88db89c65 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:18.999250 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb87906-423a-42c0-9ad9-4c0c13bf62c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:18.999877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb87906-423a-42c0-9ad9-4c0c13bf62c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:19.000156 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb87906-423a-42c0-9ad9-4c0c13bf62c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:19.000430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb87906-423a-42c0-9ad9-4c0c13bf62c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:19.009329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb87906-423a-42c0-9ad9-4c0c13bf62c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:19.010785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb87906-423a-42c0-9ad9-4c0c13bf62c6 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:19.020667 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 722/1465] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:21.513852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d62e8-14d3-4d71-b9c6-9f6e6125c2d5 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:21.514434 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d62e8-14d3-4d71-b9c6-9f6e6125c2d5 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:21.514434 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d62e8-14d3-4d71-b9c6-9f6e6125c2d5 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:21.516905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 744/1466] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:03:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:21.526555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d088e-51cc-484c-84aa-6de776abb4ac None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:21.527338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d088e-51cc-484c-84aa-6de776abb4ac None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:21.527338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d088e-51cc-484c-84aa-6de776abb4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:21.546532 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e62d088e-51cc-484c-84aa-6de776abb4ac None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:21.547753 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e62d088e-51cc-484c-84aa-6de776abb4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:21.556609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 723/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:03:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:21.601386 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d62e8-14d3-4d71-b9c6-9f6e6125c2d5 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:21.612810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d62e8-14d3-4d71-b9c6-9f6e6125c2d5 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:21.616909 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da5687-0229-421d-aafa-b6b1cbe59184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:21.617625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da5687-0229-421d-aafa-b6b1cbe59184 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:21.617910 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da5687-0229-421d-aafa-b6b1cbe59184 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:21.618200 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da5687-0229-421d-aafa-b6b1cbe59184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:21.628690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da5687-0229-421d-aafa-b6b1cbe59184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:21.630113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da5687-0229-421d-aafa-b6b1cbe59184 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:21.640435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 745/1468] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:24.024505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730f0f9-4d34-4a5c-b828-7e0a7d1e8ef2 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:24.025064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730f0f9-4d34-4a5c-b828-7e0a7d1e8ef2 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:24.025064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730f0f9-4d34-4a5c-b828-7e0a7d1e8ef2 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:24.026880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 724/1469] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:03:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:24.033515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa4dae-1350-477b-b7d2-88fe413e12bd None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:24.033934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa4dae-1350-477b-b7d2-88fe413e12bd None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:24.034062 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa4dae-1350-477b-b7d2-88fe413e12bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:24.051676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d8fa4dae-1350-477b-b7d2-88fe413e12bd None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:24.052839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d8fa4dae-1350-477b-b7d2-88fe413e12bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:24.060375 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 746/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:03:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:24.097822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730f0f9-4d34-4a5c-b828-7e0a7d1e8ef2 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:24.108581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730f0f9-4d34-4a5c-b828-7e0a7d1e8ef2 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:24.112862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8ecfb-6940-41c7-9604-cd0fa5c245f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:24.113496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8ecfb-6940-41c7-9604-cd0fa5c245f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:24.113778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8ecfb-6940-41c7-9604-cd0fa5c245f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:24.114056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8ecfb-6940-41c7-9604-cd0fa5c245f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:24.122936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8ecfb-6940-41c7-9604-cd0fa5c245f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:24.124361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8ecfb-6940-41c7-9604-cd0fa5c245f7 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:24.133656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 725/1471] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:26.522498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57213b1-bd41-4290-b495-85cb091526bc None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:26.523071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57213b1-bd41-4290-b495-85cb091526bc None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:26.523071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57213b1-bd41-4290-b495-85cb091526bc None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:26.524890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 747/1472] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:03:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:26.530699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000b91-b038-4135-9f88-181aa643de26 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:26.531115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000b91-b038-4135-9f88-181aa643de26 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:26.531292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000b91-b038-4135-9f88-181aa643de26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:26.549217 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-4b000b91-b038-4135-9f88-181aa643de26 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:26.550427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4b000b91-b038-4135-9f88-181aa643de26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:26.558030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 726/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:03:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:26.596416 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57213b1-bd41-4290-b495-85cb091526bc None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:26.609818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57213b1-bd41-4290-b495-85cb091526bc None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:26.613613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f81b63-615c-4b71-b0b0-e99e903f2182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:26.614246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f81b63-615c-4b71-b0b0-e99e903f2182 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:26.614568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f81b63-615c-4b71-b0b0-e99e903f2182 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:26.614847 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f81b63-615c-4b71-b0b0-e99e903f2182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:26.623790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f81b63-615c-4b71-b0b0-e99e903f2182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:26.625216 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f81b63-615c-4b71-b0b0-e99e903f2182 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:26.635271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 748/1474] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:43.737612 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a7591-c18f-4d95-9624-7c00986fb2d6 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:43.738155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a7591-c18f-4d95-9624-7c00986fb2d6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:43.738155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a7591-c18f-4d95-9624-7c00986fb2d6 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:43.739987 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 727/1475] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:03:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:43.745823 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd8b8b-3826-4691-9872-f576627e8277 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:43.746269 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd8b8b-3826-4691-9872-f576627e8277 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:43.746397 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd8b8b-3826-4691-9872-f576627e8277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:43.764550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e5dd8b8b-3826-4691-9872-f576627e8277 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:43.765734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e5dd8b8b-3826-4691-9872-f576627e8277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:43.773902 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 749/1476] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:03:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:43.823609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec735dd-85c6-4b85-befc-9ef2ef03a222 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:43.824005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec735dd-85c6-4b85-befc-9ef2ef03a222 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:43.824289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec735dd-85c6-4b85-befc-9ef2ef03a222 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:43.826238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 728/1477] 10.222.0.23 () {54 vars in 962 bytes} [Thu Dec 9 01:03:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:43.832235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96431f-9982-4de3-b176-a7a9198f231d None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:43.832531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96431f-9982-4de3-b176-a7a9198f231d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:43.832805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96431f-9982-4de3-b176-a7a9198f231d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:43.851059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-7a96431f-9982-4de3-b176-a7a9198f231d None None] MFA Rules not processed for user `3d001733477f499e937ba90e7e50ba33`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:43.852250 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-7a96431f-9982-4de3-b176-a7a9198f231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:43.858892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 750/1478] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Dec 9 01:03:43 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:03:43.867589 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec735dd-85c6-4b85-befc-9ef2ef03a222 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:43.878838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec735dd-85c6-4b85-befc-9ef2ef03a222 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:43.882255 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc8727-11b3-49bc-895a-e9c08b0e8bba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d001733477f499e937ba90e7e50ba33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:43.882903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc8727-11b3-49bc-895a-e9c08b0e8bba service glance] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:43.883172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc8727-11b3-49bc-895a-e9c08b0e8bba service glance] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:43.883448 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc8727-11b3-49bc-895a-e9c08b0e8bba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:43.892070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc8727-11b3-49bc-895a-e9c08b0e8bba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:43.893469 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc8727-11b3-49bc-895a-e9c08b0e8bba service glance] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:43.902508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 729/1479] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:46.359577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b15e93-9068-41ad-821f-c63dc32cb168 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:46.360193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b15e93-9068-41ad-821f-c63dc32cb168 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:46.360832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b15e93-9068-41ad-821f-c63dc32cb168 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:46.362655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 751/1480] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:03:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:46.368406 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78010cde-3d78-4259-857d-a189bdce24da None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:46.368833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78010cde-3d78-4259-857d-a189bdce24da None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:46.368951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78010cde-3d78-4259-857d-a189bdce24da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:46.386449 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-78010cde-3d78-4259-857d-a189bdce24da None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:46.387882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-78010cde-3d78-4259-857d-a189bdce24da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:46.395860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 730/1481] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:03:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:46.420297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b15e93-9068-41ad-821f-c63dc32cb168 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:46.433037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b15e93-9068-41ad-821f-c63dc32cb168 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:46.437453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef1b19-98cb-45e1-8058-cd8c5ffa59be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:46.438083 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef1b19-98cb-45e1-8058-cd8c5ffa59be admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:46.438533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef1b19-98cb-45e1-8058-cd8c5ffa59be admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:46.438818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef1b19-98cb-45e1-8058-cd8c5ffa59be admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:46.439556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef1b19-98cb-45e1-8058-cd8c5ffa59be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:46.441377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef1b19-98cb-45e1-8058-cd8c5ffa59be admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:46.459665 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 752/1482] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Dec 9 01:03:46 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:03:48.842289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6e869-7a7c-47fb-ad50-f58e37f3c46d None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:48.842899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6e869-7a7c-47fb-ad50-f58e37f3c46d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:48.842899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6e869-7a7c-47fb-ad50-f58e37f3c46d None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:48.845333 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 731/1483] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:03:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:48.853662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95383e78-4433-4065-bb8d-3cf8cc5a7dd8 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:48.854057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95383e78-4433-4065-bb8d-3cf8cc5a7dd8 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:48.854227 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95383e78-4433-4065-bb8d-3cf8cc5a7dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:48.873146 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-95383e78-4433-4065-bb8d-3cf8cc5a7dd8 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:48.874326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-95383e78-4433-4065-bb8d-3cf8cc5a7dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:48.882139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 753/1484] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:03:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:48.927617 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6e869-7a7c-47fb-ad50-f58e37f3c46d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:48.942006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6e869-7a7c-47fb-ad50-f58e37f3c46d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:48.947396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab59ff-4353-423d-89e9-0f03b9e4b3a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:48.948023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab59ff-4353-423d-89e9-0f03b9e4b3a9 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:48.948307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab59ff-4353-423d-89e9-0f03b9e4b3a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:48.948583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab59ff-4353-423d-89e9-0f03b9e4b3a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:48.957123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab59ff-4353-423d-89e9-0f03b9e4b3a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:48.958729 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab59ff-4353-423d-89e9-0f03b9e4b3a9 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:48.967814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 732/1485] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:51.543756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023e4b1-391c-467d-8c0a-c07383a72d80 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:51.544295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023e4b1-391c-467d-8c0a-c07383a72d80 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:51.544295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023e4b1-391c-467d-8c0a-c07383a72d80 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:51.546090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 754/1486] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:03:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:51.552364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414998-ef5f-4e0a-b3eb-767677f4e483 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:51.552794 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414998-ef5f-4e0a-b3eb-767677f4e483 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:51.552897 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414998-ef5f-4e0a-b3eb-767677f4e483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:51.570539 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-28414998-ef5f-4e0a-b3eb-767677f4e483 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:51.571842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-28414998-ef5f-4e0a-b3eb-767677f4e483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:51.580397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 733/1487] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:03:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:51.617152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023e4b1-391c-467d-8c0a-c07383a72d80 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:51.629296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023e4b1-391c-467d-8c0a-c07383a72d80 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:51.632936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42da583-7414-454f-9d97-b19f9c70f32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:51.633598 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42da583-7414-454f-9d97-b19f9c70f32e service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:51.633882 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42da583-7414-454f-9d97-b19f9c70f32e service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:51.634158 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42da583-7414-454f-9d97-b19f9c70f32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:51.643707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42da583-7414-454f-9d97-b19f9c70f32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:51.645173 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42da583-7414-454f-9d97-b19f9c70f32e service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:51.654431 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 755/1488] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:54.059743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f77be-009d-4c37-85ee-0619294fc142 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:54.060266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f77be-009d-4c37-85ee-0619294fc142 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:54.060266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f77be-009d-4c37-85ee-0619294fc142 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:54.062101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 734/1489] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:03:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:54.068231 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c540a1c-caa0-479c-a2d1-d006cc52c498 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:54.068677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c540a1c-caa0-479c-a2d1-d006cc52c498 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:54.068784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c540a1c-caa0-479c-a2d1-d006cc52c498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:54.087865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-7c540a1c-caa0-479c-a2d1-d006cc52c498 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:54.089066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-7c540a1c-caa0-479c-a2d1-d006cc52c498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:54.097438 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 756/1490] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:03:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:54.136837 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f77be-009d-4c37-85ee-0619294fc142 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:54.147922 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f77be-009d-4c37-85ee-0619294fc142 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:54.151475 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17206cd8-019e-476e-beef-72dc0703379e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:54.152100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17206cd8-019e-476e-beef-72dc0703379e service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:54.152386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17206cd8-019e-476e-beef-72dc0703379e service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:54.152666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17206cd8-019e-476e-beef-72dc0703379e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:54.161751 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17206cd8-019e-476e-beef-72dc0703379e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:54.163209 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17206cd8-019e-476e-beef-72dc0703379e service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:54.172993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 735/1491] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:56.729595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632d541-6d9c-4b70-bb18-52743e79121c None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:56.730221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632d541-6d9c-4b70-bb18-52743e79121c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:56.730221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632d541-6d9c-4b70-bb18-52743e79121c None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:56.732005 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 757/1492] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:03:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:56.737933 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834779af-baeb-46eb-97ba-532848b592c3 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:56.738356 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834779af-baeb-46eb-97ba-532848b592c3 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:56.738500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834779af-baeb-46eb-97ba-532848b592c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:56.757527 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-834779af-baeb-46eb-97ba-532848b592c3 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:56.758773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-834779af-baeb-46eb-97ba-532848b592c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:56.766985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 736/1493] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:03:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:56.809455 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632d541-6d9c-4b70-bb18-52743e79121c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:56.820439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632d541-6d9c-4b70-bb18-52743e79121c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:56.823950 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24b4b6-ca6b-4f82-bd41-872c8ab99ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:56.824572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24b4b6-ca6b-4f82-bd41-872c8ab99ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:56.824858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24b4b6-ca6b-4f82-bd41-872c8ab99ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:56.825137 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24b4b6-ca6b-4f82-bd41-872c8ab99ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:56.834557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24b4b6-ca6b-4f82-bd41-872c8ab99ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:56.835980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24b4b6-ca6b-4f82-bd41-872c8ab99ca6 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:56.845522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 758/1494] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:03:59.409970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91894e2e-6171-4cc2-a1f6-0ae96c0f0cd6 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:59.410577 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91894e2e-6171-4cc2-a1f6-0ae96c0f0cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:59.410577 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91894e2e-6171-4cc2-a1f6-0ae96c0f0cd6 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:59.412310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 737/1495] 10.222.0.23 () {54 vars in 926 bytes} [Thu Dec 9 01:03:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:03:59.417935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21117e3e-c00f-4101-97eb-9670e38cefdf None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:59.418343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21117e3e-c00f-4101-97eb-9670e38cefdf None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:59.418515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21117e3e-c00f-4101-97eb-9670e38cefdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:59.436527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-21117e3e-c00f-4101-97eb-9670e38cefdf None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:03:59.437694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-21117e3e-c00f-4101-97eb-9670e38cefdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:03:59.445993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 759/1496] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Dec 9 01:03:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:03:59.487666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91894e2e-6171-4cc2-a1f6-0ae96c0f0cd6 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:03:59.499243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91894e2e-6171-4cc2-a1f6-0ae96c0f0cd6 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:03:59.503459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44203d4-2326-4d47-a3e5-765aa1af5f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:03:59.504082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44203d4-2326-4d47-a3e5-765aa1af5f23 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:03:59.504358 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44203d4-2326-4d47-a3e5-765aa1af5f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:03:59.504630 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44203d4-2326-4d47-a3e5-765aa1af5f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:03:59.513292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44203d4-2326-4d47-a3e5-765aa1af5f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:03:59.514738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44203d4-2326-4d47-a3e5-765aa1af5f23 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:03:59.523724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 738/1497] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:03:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:05:12.268855 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a1da-48a5-47a0-8034-a7d84cea4196 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:12.269438 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a1da-48a5-47a0-8034-a7d84cea4196 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:12.269545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a1da-48a5-47a0-8034-a7d84cea4196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:12.287252 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2960a1da-48a5-47a0-8034-a7d84cea4196 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:05:12.288422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2960a1da-48a5-47a0-8034-a7d84cea4196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:05:12.296815 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 760/1498] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:05:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:05:12.304587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59ffa9-f3ab-41a2-ba2c-77d507ebcba7 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:12.305069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59ffa9-f3ab-41a2-ba2c-77d507ebcba7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:12.305175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59ffa9-f3ab-41a2-ba2c-77d507ebcba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:12.323551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-ab59ffa9-f3ab-41a2-ba2c-77d507ebcba7 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:05:12.324717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ab59ffa9-f3ab-41a2-ba2c-77d507ebcba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:05:12.332459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 739/1499] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:05:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:05:12.337063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a1da-48a5-47a0-8034-a7d84cea4196 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:05:12.346505 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a1da-48a5-47a0-8034-a7d84cea4196 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:05:12.350855 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c768a-5f7f-498c-81d7-8d2ce35f72cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:05:12.351756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c768a-5f7f-498c-81d7-8d2ce35f72cf admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:12.352029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c768a-5f7f-498c-81d7-8d2ce35f72cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:12.352295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c768a-5f7f-498c-81d7-8d2ce35f72cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:12.353039 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c768a-5f7f-498c-81d7-8d2ce35f72cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:05:12.353337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c768a-5f7f-498c-81d7-8d2ce35f72cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:05:12.354944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c768a-5f7f-498c-81d7-8d2ce35f72cf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:05:12.366498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 761/1500] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:05:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:05:12.375112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59ffa9-f3ab-41a2-ba2c-77d507ebcba7 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:05:12.383851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59ffa9-f3ab-41a2-ba2c-77d507ebcba7 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:05:12.388278 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a21fce-dbed-40f4-8151-dc614ef808c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:05:12.388963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a21fce-dbed-40f4-8151-dc614ef808c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:12.389241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a21fce-dbed-40f4-8151-dc614ef808c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:12.389509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a21fce-dbed-40f4-8151-dc614ef808c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:12.390194 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a21fce-dbed-40f4-8151-dc614ef808c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:05:12.392096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a21fce-dbed-40f4-8151-dc614ef808c7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:05:12.427015 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 740/1501] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:05:12 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:05:12.431170 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c768a-5f7f-498c-81d7-8d2ce35f72cf admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:05:12.441626 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c768a-5f7f-498c-81d7-8d2ce35f72cf admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:05:12.506671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa644e55-2df3-4065-9b7d-7bee639ab078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:05:12.507338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa644e55-2df3-4065-9b7d-7bee639ab078 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:12.507623 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa644e55-2df3-4065-9b7d-7bee639ab078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:12.507900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa644e55-2df3-4065-9b7d-7bee639ab078 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:12.508613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa644e55-2df3-4065-9b7d-7bee639ab078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:05:12.510619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa644e55-2df3-4065-9b7d-7bee639ab078 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:05:12.531207 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 762/1502] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:05:12 2021] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:05:12.535518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a21fce-dbed-40f4-8151-dc614ef808c7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:05:12.546279 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a21fce-dbed-40f4-8151-dc614ef808c7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:05:12.550824 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec213f-9b9d-4bd4-a480-46898bd380b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:05:12.551463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec213f-9b9d-4bd4-a480-46898bd380b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:12.551749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec213f-9b9d-4bd4-a480-46898bd380b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:12.552024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec213f-9b9d-4bd4-a480-46898bd380b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:12.552768 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec213f-9b9d-4bd4-a480-46898bd380b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:05:12.554334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec213f-9b9d-4bd4-a480-46898bd380b2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:05:12.566929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 741/1503] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:05:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:05:12.570900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa644e55-2df3-4065-9b7d-7bee639ab078 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:05:12.585147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa644e55-2df3-4065-9b7d-7bee639ab078 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:05:12.589757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e7e6b-85c3-402e-8feb-adf25027a57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:05:12.590446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e7e6b-85c3-402e-8feb-adf25027a57e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:12.590728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e7e6b-85c3-402e-8feb-adf25027a57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:12.591004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e7e6b-85c3-402e-8feb-adf25027a57e admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:12.592278 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e7e6b-85c3-402e-8feb-adf25027a57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:05:12.594309 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e7e6b-85c3-402e-8feb-adf25027a57e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:05:12.609058 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 763/1504] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:05:12 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:05:12.613407 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec213f-9b9d-4bd4-a480-46898bd380b2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:05:12.626824 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec213f-9b9d-4bd4-a480-46898bd380b2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:05:12.631314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b229203-7d46-45e9-9eec-c4146ed08bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:05:12.632182 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b229203-7d46-45e9-9eec-c4146ed08bce admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:12.632464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b229203-7d46-45e9-9eec-c4146ed08bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:12.632741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b229203-7d46-45e9-9eec-c4146ed08bce admin admin] PATH_INFO: `/v3/projects/0eeb827886c5421db4cdd01038671a79/users/ac48a0d3e3d04526966597cc0b3d1871/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:12.646969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b229203-7d46-45e9-9eec-c4146ed08bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eeb827886c5421db4cdd01038671a79, user_id=ac48a0d3e3d04526966597cc0b3d1871, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:05:12.649599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b229203-7d46-45e9-9eec-c4146ed08bce admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:05:12.663029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 742/1505] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:05:12 2021] PUT /identity/v3/projects/0eeb827886c5421db4cdd01038671a79/users/ac48a0d3e3d04526966597cc0b3d1871/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:05:12.675543 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d32fe-ee23-44da-9051-f5b6cee61982 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:12.675833 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d32fe-ee23-44da-9051-f5b6cee61982 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:12.676095 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d32fe-ee23-44da-9051-f5b6cee61982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:12.701426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ed0d32fe-ee23-44da-9051-f5b6cee61982 None None] MFA Rules not processed for user `ac48a0d3e3d04526966597cc0b3d1871`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:05:12.702685 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ed0d32fe-ee23-44da-9051-f5b6cee61982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:05:12.764659 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 764/1506] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:05:12 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:05:12.776898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b229203-7d46-45e9-9eec-c4146ed08bce admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:05:12.844109 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b229203-7d46-45e9-9eec-c4146ed08bce admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:05:12.849691 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5634795-7142-4571-b06a-7005c0cb3072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:05:12.850427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5634795-7142-4571-b06a-7005c0cb3072 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:12.850653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5634795-7142-4571-b06a-7005c0cb3072 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:12.850904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5634795-7142-4571-b06a-7005c0cb3072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:12.859699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5634795-7142-4571-b06a-7005c0cb3072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:05:12.861260 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5634795-7142-4571-b06a-7005c0cb3072 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:05:12.869666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 743/1507] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:05:12 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:05:12.938470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f259-f915-403d-abf7-080331f251f5 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:12.938763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f259-f915-403d-abf7-080331f251f5 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:12.939047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f259-f915-403d-abf7-080331f251f5 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:12.940743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 765/1508] 10.222.0.23 () {52 vars in 829 bytes} [Thu Dec 9 01:05:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:05:12.944616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5634795-7142-4571-b06a-7005c0cb3072 service nova] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:05:13.008449 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5634795-7142-4571-b06a-7005c0cb3072 service nova] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:05:13.012960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:05:13.013866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:13.014196 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:13.014553 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] PATH_INFO: `/v3/users/ac48a0d3e3d04526966597cc0b3d1871` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:13.015759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac48a0d3e3d04526966597cc0b3d1871)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:05:13.016790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:05:13.016790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 01:05:13.016790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 01:05:13.017991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:05:13.080414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac48a0d3e3d04526966597cc0b3d1871'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:05:13.092616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac48a0d3e3d04526966597cc0b3d1871'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:05:13.093372 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac48a0d3e3d04526966597cc0b3d1871'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:05:13.093989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac48a0d3e3d04526966597cc0b3d1871'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:05:13.113967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac48a0d3e3d04526966597cc0b3d1871'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:05:13.128767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 744/1509] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:05:12 2021] DELETE /identity/v3/users/ac48a0d3e3d04526966597cc0b3d1871 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:05:13.133247 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e7933-06d3-4deb-972c-f94e73515d70 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:13.133532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e7933-06d3-4deb-972c-f94e73515d70 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:13.133810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e7933-06d3-4deb-972c-f94e73515d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:13.152851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d46e7933-06d3-4deb-972c-f94e73515d70 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:05:13.154038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d46e7933-06d3-4deb-972c-f94e73515d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:05:13.209020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 766/1510] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:05:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:05:13.218862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:05:13.220287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:05:13.275162 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725cd5c-ce54-417f-aa3f-25677a68bb83 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:05:13.278650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518358f-725a-4605-93de-57d22c92195f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:05:13.279818 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518358f-725a-4605-93de-57d22c92195f service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:13.280109 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518358f-725a-4605-93de-57d22c92195f service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:13.280353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518358f-725a-4605-93de-57d22c92195f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:13.288978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518358f-725a-4605-93de-57d22c92195f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:05:13.290430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518358f-725a-4605-93de-57d22c92195f service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:05:13.302169 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 745/1511] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:05:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:05:13.652974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e7933-06d3-4deb-972c-f94e73515d70 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:05:13.654962 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d46e7933-06d3-4deb-972c-f94e73515d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:05:13.666593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e7933-06d3-4deb-972c-f94e73515d70 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:05:13.671572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:05:13.672417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:05:13.672703 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:05:13.672976 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] PATH_INFO: `/v3/projects/0eeb827886c5421db4cdd01038671a79` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:05:13.674199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eeb827886c5421db4cdd01038671a79)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:05:13.675245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:05:13.675245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 01:05:13.675245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 01:05:13.677959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:05:13.745130 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eeb827886c5421db4cdd01038671a79', 'request_id': 'req-48b28446-bf01-439c-9889-3b8ee38ced0d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:05:13.758343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eeb827886c5421db4cdd01038671a79', 'request_id': 'req-48b28446-bf01-439c-9889-3b8ee38ced0d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:05:13.768409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eeb827886c5421db4cdd01038671a79', 'request_id': 'req-48b28446-bf01-439c-9889-3b8ee38ced0d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:05:13.779991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] The token cache is being invalidate because project 0eeb827886c5421db4cdd01038671a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:05:13.780234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:05:13.780866 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-48b28446-bf01-439c-9889-3b8ee38ced0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:05:13.782532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 767/1512] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:05:13 2021] DELETE /identity/v3/projects/0eeb827886c5421db4cdd01038671a79 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:06:42.086805 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70713e-9089-4d5f-9f54-d0ad0909323a None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:42.087399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70713e-9089-4d5f-9f54-d0ad0909323a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:42.087399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70713e-9089-4d5f-9f54-d0ad0909323a None None] PATH_INFO: `/v3` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:42.088728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 746/1513] 10.222.0.46 () {54 vars in 925 bytes} [Thu Dec 9 01:06:42 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:06:42.096411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf92f-ae7e-4a8a-bb88-a27670f0a485 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:42.096857 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf92f-ae7e-4a8a-bb88-a27670f0a485 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:42.096963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf92f-ae7e-4a8a-bb88-a27670f0a485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:42.115495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e2cbf92f-ae7e-4a8a-bb88-a27670f0a485 None None] MFA Rules not processed for user `a2cebb33ff7c4e40a06b3c7f1a40823d`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:06:42.116628 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e2cbf92f-ae7e-4a8a-bb88-a27670f0a485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:06:42.180991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 768/1514] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Dec 9 01:06:42 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:06:42.460740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84822d46-cd1e-4eee-98f0-7c6b5f94e741 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:42.460932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84822d46-cd1e-4eee-98f0-7c6b5f94e741 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:42.461219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84822d46-cd1e-4eee-98f0-7c6b5f94e741 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:42.463023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 747/1515] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 9 01:06:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:06:42.468289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03888c47-08b1-4e0b-8cd3-bbcfa8ec4a7c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:42.468576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03888c47-08b1-4e0b-8cd3-bbcfa8ec4a7c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:42.469424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03888c47-08b1-4e0b-8cd3-bbcfa8ec4a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:42.487707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-03888c47-08b1-4e0b-8cd3-bbcfa8ec4a7c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:06:42.488909 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-03888c47-08b1-4e0b-8cd3-bbcfa8ec4a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:06:42.543302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 769/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 9 01:06:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:06:42.696677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84822d46-cd1e-4eee-98f0-7c6b5f94e741 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:06:42.698405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-84822d46-cd1e-4eee-98f0-7c6b5f94e741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:06:42.769539 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84822d46-cd1e-4eee-98f0-7c6b5f94e741 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:06:42.774686 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf34f6-babf-4a31-aa39-feb2e256dd24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:06:42.775312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf34f6-babf-4a31-aa39-feb2e256dd24 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:42.775590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf34f6-babf-4a31-aa39-feb2e256dd24 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:42.775859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf34f6-babf-4a31-aa39-feb2e256dd24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:42.784492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf34f6-babf-4a31-aa39-feb2e256dd24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:06:42.786087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf34f6-babf-4a31-aa39-feb2e256dd24 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:06:42.795191 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 748/1517] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:06:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:06:44.314975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05442a-038b-4def-9451-3a580c90cadb None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:44.315533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05442a-038b-4def-9451-3a580c90cadb None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:44.315533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05442a-038b-4def-9451-3a580c90cadb None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:44.317332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 770/1518] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 9 01:06:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:06:44.322685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cfe0c-7357-4214-8279-b3a1fbcd0229 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:44.323083 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cfe0c-7357-4214-8279-b3a1fbcd0229 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:44.323240 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cfe0c-7357-4214-8279-b3a1fbcd0229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:44.343384 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d93cfe0c-7357-4214-8279-b3a1fbcd0229 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:06:44.344822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d93cfe0c-7357-4214-8279-b3a1fbcd0229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:06:44.352756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 749/1519] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 9 01:06:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:06:44.507101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05442a-038b-4def-9451-3a580c90cadb None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:06:44.521164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05442a-038b-4def-9451-3a580c90cadb None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:06:44.526611 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fecf31-1f0e-4aca-b20d-6b260dc63f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:06:44.527240 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fecf31-1f0e-4aca-b20d-6b260dc63f62 service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:44.527533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fecf31-1f0e-4aca-b20d-6b260dc63f62 service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:44.527813 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fecf31-1f0e-4aca-b20d-6b260dc63f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:44.536487 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fecf31-1f0e-4aca-b20d-6b260dc63f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:06:44.538759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fecf31-1f0e-4aca-b20d-6b260dc63f62 service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:06:44.551749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 771/1520] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:06:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:06:50.723350 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c848c5c-76db-4252-b001-6e2d016eb3df None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:50.723800 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c848c5c-76db-4252-b001-6e2d016eb3df None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:50.723942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c848c5c-76db-4252-b001-6e2d016eb3df None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:50.726028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 750/1521] 10.222.0.23 () {54 vars in 960 bytes} [Thu Dec 9 01:06:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:06:50.731264 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3b847-c4ec-4e12-9d62-a24a52c60b51 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:50.731693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3b847-c4ec-4e12-9d62-a24a52c60b51 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:50.731802 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3b847-c4ec-4e12-9d62-a24a52c60b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:50.749853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-1fb3b847-c4ec-4e12-9d62-a24a52c60b51 None None] MFA Rules not processed for user `a2cebb33ff7c4e40a06b3c7f1a40823d`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:06:50.751177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1fb3b847-c4ec-4e12-9d62-a24a52c60b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:06:50.759498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 772/1522] 10.222.0.23 () {58 vars in 1057 bytes} [Thu Dec 9 01:06:50 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:06:50.767345 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c848c5c-76db-4252-b001-6e2d016eb3df None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:06:50.780563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c848c5c-76db-4252-b001-6e2d016eb3df None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:06:50.786263 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ac6b0-7845-4752-8675-8531c8118dd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cebb33ff7c4e40a06b3c7f1a40823d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:06:50.786918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ac6b0-7845-4752-8675-8531c8118dd9 service placement] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:50.787196 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ac6b0-7845-4752-8675-8531c8118dd9 service placement] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:50.787479 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ac6b0-7845-4752-8675-8531c8118dd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:50.795594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ac6b0-7845-4752-8675-8531c8118dd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:06:50.797960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ac6b0-7845-4752-8675-8531c8118dd9 service placement] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:06:50.807377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 751/1523] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:06:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:06:56.491062 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82a168-ce01-4279-a3d2-7dadf64b826d None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:56.491576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82a168-ce01-4279-a3d2-7dadf64b826d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:56.491576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82a168-ce01-4279-a3d2-7dadf64b826d None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:56.493453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 773/1524] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 9 01:06:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:06:56.498856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615a566-493f-427b-b301-882037dd0ade None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:56.499237 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615a566-493f-427b-b301-882037dd0ade None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:56.499431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615a566-493f-427b-b301-882037dd0ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:56.517933 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-0615a566-493f-427b-b301-882037dd0ade None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:06:56.519156 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0615a566-493f-427b-b301-882037dd0ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:06:56.526801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 752/1525] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 9 01:06:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:06:56.689204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82a168-ce01-4279-a3d2-7dadf64b826d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:06:56.703881 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82a168-ce01-4279-a3d2-7dadf64b826d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:06:56.709204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8eb2c-e7a8-4dbf-8160-ab711117418c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:06:56.709831 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8eb2c-e7a8-4dbf-8160-ab711117418c service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:56.710116 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8eb2c-e7a8-4dbf-8160-ab711117418c service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:56.710422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8eb2c-e7a8-4dbf-8160-ab711117418c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:56.718264 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8eb2c-e7a8-4dbf-8160-ab711117418c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:06:56.719865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8eb2c-e7a8-4dbf-8160-ab711117418c service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:06:56.729310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 774/1526] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:06:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:06:58.227642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275749a-60ae-43ec-a8e1-4714469cd92f None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:58.228086 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275749a-60ae-43ec-a8e1-4714469cd92f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:58.228295 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275749a-60ae-43ec-a8e1-4714469cd92f None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:58.229965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 753/1527] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 9 01:06:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:06:58.235977 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35c08-c009-4c49-bc0d-5e6891acd660 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:58.236400 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35c08-c009-4c49-bc0d-5e6891acd660 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:58.236529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35c08-c009-4c49-bc0d-5e6891acd660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:58.255558 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-c4e35c08-c009-4c49-bc0d-5e6891acd660 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:06:58.256767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c4e35c08-c009-4c49-bc0d-5e6891acd660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:06:58.265191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 775/1528] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 9 01:06:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:06:58.429521 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275749a-60ae-43ec-a8e1-4714469cd92f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:06:58.443475 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275749a-60ae-43ec-a8e1-4714469cd92f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:06:58.448788 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c48f-60ff-4168-a663-606a72ea09a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:06:58.449410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c48f-60ff-4168-a663-606a72ea09a9 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:06:58.449694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c48f-60ff-4168-a663-606a72ea09a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:06:58.449974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c48f-60ff-4168-a663-606a72ea09a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:06:58.457841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56c48f-60ff-4168-a663-606a72ea09a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:06:58.459434 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56c48f-60ff-4168-a663-606a72ea09a9 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:06:58.469153 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 754/1529] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:06:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:07:02.744154 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc8bee-a636-4f42-b79f-844ceb522d53 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:02.744761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc8bee-a636-4f42-b79f-844ceb522d53 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:02.744761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc8bee-a636-4f42-b79f-844ceb522d53 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:02.746481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 776/1530] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:07:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:07:02.753044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f5f7-1454-4a85-8ac8-2f9cc9aadf12 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:02.753495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f5f7-1454-4a85-8ac8-2f9cc9aadf12 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:02.753609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f5f7-1454-4a85-8ac8-2f9cc9aadf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:02.771719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c361f5f7-1454-4a85-8ac8-2f9cc9aadf12 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:07:02.772916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c361f5f7-1454-4a85-8ac8-2f9cc9aadf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:07:02.780595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 755/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:07:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:07:02.818945 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc8bee-a636-4f42-b79f-844ceb522d53 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:07:02.820644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-90fc8bee-a636-4f42-b79f-844ceb522d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:07:02.876693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc8bee-a636-4f42-b79f-844ceb522d53 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:07:02.880232 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80aa0d-5613-4f8b-bc27-3273d4a6391f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:07:02.880866 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80aa0d-5613-4f8b-bc27-3273d4a6391f service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:02.881149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80aa0d-5613-4f8b-bc27-3273d4a6391f service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:02.881425 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80aa0d-5613-4f8b-bc27-3273d4a6391f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:02.890057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80aa0d-5613-4f8b-bc27-3273d4a6391f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:07:02.891535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80aa0d-5613-4f8b-bc27-3273d4a6391f service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:07:02.900593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 777/1532] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:07:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:07:05.266126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843991-881a-4370-8e1c-332f5880e746 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:05.266674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843991-881a-4370-8e1c-332f5880e746 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:05.266674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843991-881a-4370-8e1c-332f5880e746 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:05.268387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 756/1533] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:07:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:07:05.274792 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b1b90-3796-45ec-9c5e-529e330e485e None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:05.275233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b1b90-3796-45ec-9c5e-529e330e485e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:05.275336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b1b90-3796-45ec-9c5e-529e330e485e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:05.293424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-1f3b1b90-3796-45ec-9c5e-529e330e485e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:07:05.294648 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1f3b1b90-3796-45ec-9c5e-529e330e485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:07:05.303291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 778/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:07:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:07:05.340141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f843991-881a-4370-8e1c-332f5880e746 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:07:05.350969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f843991-881a-4370-8e1c-332f5880e746 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:07:05.354408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376fa4-6f45-4ce5-afa8-b9c04175c320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:07:05.355028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376fa4-6f45-4ce5-afa8-b9c04175c320 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:05.355307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376fa4-6f45-4ce5-afa8-b9c04175c320 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:05.355577 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376fa4-6f45-4ce5-afa8-b9c04175c320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:05.364984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e376fa4-6f45-4ce5-afa8-b9c04175c320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:07:05.366410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e376fa4-6f45-4ce5-afa8-b9c04175c320 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:07:05.376190 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 757/1535] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:07:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:07:09.391317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f8fe2-95cc-472c-8adc-d31b6109f7ec None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:09.391884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f8fe2-95cc-472c-8adc-d31b6109f7ec None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:09.391884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f8fe2-95cc-472c-8adc-d31b6109f7ec None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:09.393644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 779/1536] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:07:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 01:07:09.399372 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2c8b4-f656-4c71-809d-538684a60aa1 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:09.399799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2c8b4-f656-4c71-809d-538684a60aa1 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:09.399923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2c8b4-f656-4c71-809d-538684a60aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:09.417523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-56a2c8b4-f656-4c71-809d-538684a60aa1 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:07:09.418736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-56a2c8b4-f656-4c71-809d-538684a60aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:07:09.426657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 758/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:07:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:07:09.476927 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f8fe2-95cc-472c-8adc-d31b6109f7ec None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:07:09.478623 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-4c1f8fe2-95cc-472c-8adc-d31b6109f7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:07:09.533695 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f8fe2-95cc-472c-8adc-d31b6109f7ec None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:07:09.537161 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40975d-318b-4068-93e2-98b70de484f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:07:09.537824 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40975d-318b-4068-93e2-98b70de484f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:09.538107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40975d-318b-4068-93e2-98b70de484f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:09.538412 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40975d-318b-4068-93e2-98b70de484f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:09.547102 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40975d-318b-4068-93e2-98b70de484f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:07:09.548516 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40975d-318b-4068-93e2-98b70de484f6 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:07:09.557563 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 780/1538] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:07:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:07:11.925381 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4bce9-ec93-4767-82a2-86a69fed983c None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:11.925878 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4bce9-ec93-4767-82a2-86a69fed983c None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:11.926006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4bce9-ec93-4767-82a2-86a69fed983c None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:11.927709 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 759/1539] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 9 01:07:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:07:11.933398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe1cb-f685-4ffb-90e1-1727b886cd0f None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:11.933823 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe1cb-f685-4ffb-90e1-1727b886cd0f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:11.933942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe1cb-f685-4ffb-90e1-1727b886cd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:11.951323 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ea8fe1cb-f685-4ffb-90e1-1727b886cd0f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:07:11.952536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ea8fe1cb-f685-4ffb-90e1-1727b886cd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:07:11.960159 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 781/1540] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 9 01:07:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:07:12.012207 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4e12a-c52a-4f33-8e12-ccbac69bd963 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:12.012486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4e12a-c52a-4f33-8e12-ccbac69bd963 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:12.012758 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4e12a-c52a-4f33-8e12-ccbac69bd963 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:12.014530 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 760/1541] 10.222.0.23 () {54 vars in 963 bytes} [Thu Dec 9 01:07:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:07:12.020523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148d1dd-be50-4ecd-8970-2adb1ec9ebe5 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:12.020808 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148d1dd-be50-4ecd-8970-2adb1ec9ebe5 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:12.021112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148d1dd-be50-4ecd-8970-2adb1ec9ebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:12.039899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e148d1dd-be50-4ecd-8970-2adb1ec9ebe5 None None] MFA Rules not processed for user `fb5625c813724729bb927c201f23e417`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:07:12.041080 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e148d1dd-be50-4ecd-8970-2adb1ec9ebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:07:12.047677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 782/1542] 10.222.0.23 () {58 vars in 1060 bytes} [Thu Dec 9 01:07:12 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:07:12.055297 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4e12a-c52a-4f33-8e12-ccbac69bd963 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:07:12.065786 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4e12a-c52a-4f33-8e12-ccbac69bd963 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:07:12.069303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20611f32-bd92-4680-aff2-dd0cdb60a1cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:07:12.069921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20611f32-bd92-4680-aff2-dd0cdb60a1cb service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:07:12.070207 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20611f32-bd92-4680-aff2-dd0cdb60a1cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:07:12.070509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20611f32-bd92-4680-aff2-dd0cdb60a1cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:07:12.080020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20611f32-bd92-4680-aff2-dd0cdb60a1cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:07:12.081439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20611f32-bd92-4680-aff2-dd0cdb60a1cb service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:07:12.090719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 761/1543] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:07:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:33.810143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940ebd5-cb28-4953-abb4-f391288f91ae None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:33.812068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940ebd5-cb28-4953-abb4-f391288f91ae None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:33.812704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940ebd5-cb28-4953-abb4-f391288f91ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:33.843710 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-b940ebd5-cb28-4953-abb4-f391288f91ae None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:33.845278 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b940ebd5-cb28-4953-abb4-f391288f91ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:33.860482 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 783/1544] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:33.869250 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98ee1-930a-47f5-83c3-dc7918fbe958 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:33.871456 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98ee1-930a-47f5-83c3-dc7918fbe958 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:33.871456 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98ee1-930a-47f5-83c3-dc7918fbe958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:33.903038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-22a98ee1-930a-47f5-83c3-dc7918fbe958 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:33.905851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-22a98ee1-930a-47f5-83c3-dc7918fbe958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:33.917379 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 762/1545] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:33.922506 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940ebd5-cb28-4953-abb4-f391288f91ae None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:33.937942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940ebd5-cb28-4953-abb4-f391288f91ae None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:33.938806 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69983a-7b6b-4b3c-b027-761940f15963 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:33.939098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69983a-7b6b-4b3c-b027-761940f15963 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:33.939382 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69983a-7b6b-4b3c-b027-761940f15963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:33.945159 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc95c0e-4f64-487e-ba59-610eedbe979b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:33.946214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc95c0e-4f64-487e-ba59-610eedbe979b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:33.946888 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc95c0e-4f64-487e-ba59-610eedbe979b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:33.947385 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc95c0e-4f64-487e-ba59-610eedbe979b admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:33.948346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc95c0e-4f64-487e-ba59-610eedbe979b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:08:33.948889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc95c0e-4f64-487e-ba59-610eedbe979b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:33.951380 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc95c0e-4f64-487e-ba59-610eedbe979b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:33.969517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 784/1546] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:08:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:08:33.971789 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c6c9-f93a-485d-88a1-f73d359da2f2 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:33.972551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c6c9-f93a-485d-88a1-f73d359da2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:33.972682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-3a69983a-7b6b-4b3c-b027-761940f15963 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:33.973181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c6c9-f93a-485d-88a1-f73d359da2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:33.973886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-3a69983a-7b6b-4b3c-b027-761940f15963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:33.992634 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 763/1547] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:08:33.993956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69983a-7b6b-4b3c-b027-761940f15963 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.008204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a262c6c9-f93a-485d-88a1-f73d359da2f2 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.011138 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a262c6c9-f93a-485d-88a1-f73d359da2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.014012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69983a-7b6b-4b3c-b027-761940f15963 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.023258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfa99d-a0f2-46fb-bb75-e2afd0e22110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.025463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa99d-a0f2-46fb-bb75-e2afd0e22110 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.026346 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa99d-a0f2-46fb-bb75-e2afd0e22110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.027545 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa99d-a0f2-46fb-bb75-e2afd0e22110 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.028917 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfa99d-a0f2-46fb-bb75-e2afd0e22110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.029759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 785/1548] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.031387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbfffe-906b-4485-8d3d-7f73668b1289 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.031998 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbfffe-906b-4485-8d3d-7f73668b1289 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.032465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbfffe-906b-4485-8d3d-7f73668b1289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.035983 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfa99d-a0f2-46fb-bb75-e2afd0e22110 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.053128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-4cbbfffe-906b-4485-8d3d-7f73668b1289 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.055952 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-4cbbfffe-906b-4485-8d3d-7f73668b1289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.065921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 786/1549] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.067428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad91a0-1bb8-4c15-be67-b525eadce931 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.067790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad91a0-1bb8-4c15-be67-b525eadce931 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.068127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad91a0-1bb8-4c15-be67-b525eadce931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.071584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 764/1550] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:33 2021] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:34.073254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3345b-b155-4f1a-b849-7e3d9bd8d947 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.073784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3345b-b155-4f1a-b849-7e3d9bd8d947 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.074396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3345b-b155-4f1a-b849-7e3d9bd8d947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.088215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-c4ad91a0-1bb8-4c15-be67-b525eadce931 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.089590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c4ad91a0-1bb8-4c15-be67-b525eadce931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.099258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-94c3345b-b155-4f1a-b849-7e3d9bd8d947 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.102030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-94c3345b-b155-4f1a-b849-7e3d9bd8d947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.175574 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 787/1551] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.176859 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952831a-5dc8-49fc-9df5-3179fafaedcb None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.178764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952831a-5dc8-49fc-9df5-3179fafaedcb None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.178764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952831a-5dc8-49fc-9df5-3179fafaedcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.191884 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 765/1552] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.193284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8fb13-7529-4802-baad-17d97a81582b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.193673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8fb13-7529-4802-baad-17d97a81582b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.194079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8fb13-7529-4802-baad-17d97a81582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.203770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d952831a-5dc8-49fc-9df5-3179fafaedcb None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.205014 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d952831a-5dc8-49fc-9df5-3179fafaedcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.212727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b2d8fb13-7529-4802-baad-17d97a81582b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.212896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 788/1553] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.213786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952831a-5dc8-49fc-9df5-3179fafaedcb None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.214303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b2d8fb13-7529-4802-baad-17d97a81582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.223587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 766/1554] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.224002 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952831a-5dc8-49fc-9df5-3179fafaedcb None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.224715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ce18b-0583-44d4-b54f-6b2d15787a68 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.225059 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ce18b-0583-44d4-b54f-6b2d15787a68 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.225298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ce18b-0583-44d4-b54f-6b2d15787a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.228656 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e05b09-feba-45c2-8828-b1ea51fe684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.229287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e05b09-feba-45c2-8828-b1ea51fe684d admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.229568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e05b09-feba-45c2-8828-b1ea51fe684d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.229841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e05b09-feba-45c2-8828-b1ea51fe684d admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.230593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e05b09-feba-45c2-8828-b1ea51fe684d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.233338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e05b09-feba-45c2-8828-b1ea51fe684d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.244555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-7a3ce18b-0583-44d4-b54f-6b2d15787a68 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.245763 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7a3ce18b-0583-44d4-b54f-6b2d15787a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.253278 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 789/1555] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:34.254682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 767/1556] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.254963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2614d6a-4879-41a8-a527-7b2444e5f4e0 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.255513 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2614d6a-4879-41a8-a527-7b2444e5f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.255629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ce18b-0583-44d4-b54f-6b2d15787a68 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.256133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2614d6a-4879-41a8-a527-7b2444e5f4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.265722 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ce18b-0583-44d4-b54f-6b2d15787a68 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.270248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de946df0-0303-401f-9c3d-522c5cac208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.270927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de946df0-0303-401f-9c3d-522c5cac208f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.271210 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de946df0-0303-401f-9c3d-522c5cac208f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.271485 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de946df0-0303-401f-9c3d-522c5cac208f admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.272212 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de946df0-0303-401f-9c3d-522c5cac208f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:08:34.272518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de946df0-0303-401f-9c3d-522c5cac208f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.274091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-b2614d6a-4879-41a8-a527-7b2444e5f4e0 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.274245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de946df0-0303-401f-9c3d-522c5cac208f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.275357 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b2614d6a-4879-41a8-a527-7b2444e5f4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.285829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 790/1557] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.286539 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 768/1558] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:08:34.287133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cfc35-4575-4ace-8d2d-ade8c6c7b551 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.287423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cfc35-4575-4ace-8d2d-ade8c6c7b551 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.287700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cfc35-4575-4ace-8d2d-ade8c6c7b551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.295133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0bbb2-4db9-46c5-b54d-29d2c679f725 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.295419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0bbb2-4db9-46c5-b54d-29d2c679f725 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.295696 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0bbb2-4db9-46c5-b54d-29d2c679f725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.309604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-082cfc35-4575-4ace-8d2d-ade8c6c7b551 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.311059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-082cfc35-4575-4ace-8d2d-ade8c6c7b551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.313847 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-1bc0bbb2-4db9-46c5-b54d-29d2c679f725 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.315062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-1bc0bbb2-4db9-46c5-b54d-29d2c679f725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.319059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 791/1559] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.319956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cfc35-4575-4ace-8d2d-ade8c6c7b551 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.322902 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 769/1560] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.327747 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bfe6c-6b3b-4387-b2ee-c7debfdb6c5f None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.328040 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bfe6c-6b3b-4387-b2ee-c7debfdb6c5f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.328323 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bfe6c-6b3b-4387-b2ee-c7debfdb6c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.329649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cfc35-4575-4ace-8d2d-ade8c6c7b551 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.334141 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5be671-6277-4e7a-b586-60b8e0064974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.334826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5be671-6277-4e7a-b586-60b8e0064974 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.335111 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5be671-6277-4e7a-b586-60b8e0064974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.335391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5be671-6277-4e7a-b586-60b8e0064974 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.336125 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5be671-6277-4e7a-b586-60b8e0064974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:08:34.336432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5be671-6277-4e7a-b586-60b8e0064974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.338030 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5be671-6277-4e7a-b586-60b8e0064974 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.346811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b35bfe6c-6b3b-4387-b2ee-c7debfdb6c5f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.348254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b35bfe6c-6b3b-4387-b2ee-c7debfdb6c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.350335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 792/1561] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:08:34.351290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5be671-6277-4e7a-b586-60b8e0064974 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.356931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 770/1562] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.357761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bfe6c-6b3b-4387-b2ee-c7debfdb6c5f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.363519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5be671-6277-4e7a-b586-60b8e0064974 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.367179 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bfe6c-6b3b-4387-b2ee-c7debfdb6c5f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.368120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b632156-61f4-40e2-b868-57b151c04d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.368766 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b632156-61f4-40e2-b868-57b151c04d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.369054 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b632156-61f4-40e2-b868-57b151c04d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.369332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b632156-61f4-40e2-b868-57b151c04d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.370065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b632156-61f4-40e2-b868-57b151c04d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:08:34.370419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b632156-61f4-40e2-b868-57b151c04d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.371838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449652d-3b67-424a-a0e6-8eabb94b10d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.372048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b632156-61f4-40e2-b868-57b151c04d1b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.372816 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449652d-3b67-424a-a0e6-8eabb94b10d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.373290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449652d-3b67-424a-a0e6-8eabb94b10d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.373574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449652d-3b67-424a-a0e6-8eabb94b10d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.374312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449652d-3b67-424a-a0e6-8eabb94b10d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.375934 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449652d-3b67-424a-a0e6-8eabb94b10d7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.383737 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 793/1563] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:08:34.385055 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278d8e9-a1b6-4e50-8dc7-f167f08740e2 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.385330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278d8e9-a1b6-4e50-8dc7-f167f08740e2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.385631 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278d8e9-a1b6-4e50-8dc7-f167f08740e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.388871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 771/1564] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:34 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:34.388871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449652d-3b67-424a-a0e6-8eabb94b10d7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.399080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449652d-3b67-424a-a0e6-8eabb94b10d7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.405093 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a7cf1-cc5a-4d5f-8421-806f3f018e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.405766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a7cf1-cc5a-4d5f-8421-806f3f018e5a admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.406050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a7cf1-cc5a-4d5f-8421-806f3f018e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.406329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a7cf1-cc5a-4d5f-8421-806f3f018e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.406569 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-1278d8e9-a1b6-4e50-8dc7-f167f08740e2 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.407067 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a7cf1-cc5a-4d5f-8421-806f3f018e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.407869 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1278d8e9-a1b6-4e50-8dc7-f167f08740e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.409013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a7cf1-cc5a-4d5f-8421-806f3f018e5a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.416261 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 794/1565] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.418222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f776f5-db42-438a-accf-5cff3bda96b9 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.418550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f776f5-db42-438a-accf-5cff3bda96b9 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.418894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f776f5-db42-438a-accf-5cff3bda96b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.437843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-02f776f5-db42-438a-accf-5cff3bda96b9 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:34.439080 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-02f776f5-db42-438a-accf-5cff3bda96b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:34.445531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 772/1566] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:34.446447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a7cf1-cc5a-4d5f-8421-806f3f018e5a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.507764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 795/1567] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:34.508602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f776f5-db42-438a-accf-5cff3bda96b9 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.514637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a7cf1-cc5a-4d5f-8421-806f3f018e5a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.518328 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f776f5-db42-438a-accf-5cff3bda96b9 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.519407 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d00801-4ae1-4b3f-a0f8-7c86bad6eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.520059 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d00801-4ae1-4b3f-a0f8-7c86bad6eb5c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.520339 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d00801-4ae1-4b3f-a0f8-7c86bad6eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.520664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d00801-4ae1-4b3f-a0f8-7c86bad6eb5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.521395 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d00801-4ae1-4b3f-a0f8-7c86bad6eb5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:08:34.521702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d00801-4ae1-4b3f-a0f8-7c86bad6eb5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.522938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e6e7f-3726-4a36-bba5-6905151d9abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.523447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d00801-4ae1-4b3f-a0f8-7c86bad6eb5c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.523588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e6e7f-3726-4a36-bba5-6905151d9abf admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.523848 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e6e7f-3726-4a36-bba5-6905151d9abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.524124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e6e7f-3726-4a36-bba5-6905151d9abf admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.524817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e6e7f-3726-4a36-bba5-6905151d9abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.526725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e6e7f-3726-4a36-bba5-6905151d9abf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.535869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 773/1568] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:08:34.537014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d00801-4ae1-4b3f-a0f8-7c86bad6eb5c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.555872 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 796/1569] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:34.556109 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d00801-4ae1-4b3f-a0f8-7c86bad6eb5c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.556242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e6e7f-3726-4a36-bba5-6905151d9abf admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.607534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ea58c-aac1-42de-a46c-05e7493beaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.608106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea58c-aac1-42de-a46c-05e7493beaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.608388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea58c-aac1-42de-a46c-05e7493beaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.608664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea58c-aac1-42de-a46c-05e7493beaf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.609392 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ea58c-aac1-42de-a46c-05e7493beaf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:08:34.609696 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ea58c-aac1-42de-a46c-05e7493beaf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.611341 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ea58c-aac1-42de-a46c-05e7493beaf7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.613765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e6e7f-3726-4a36-bba5-6905151d9abf admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.618339 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e0d20-99c4-46f8-9c53-207aa1a9dd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.619026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0d20-99c4-46f8-9c53-207aa1a9dd33 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.619309 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0d20-99c4-46f8-9c53-207aa1a9dd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.619586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0d20-99c4-46f8-9c53-207aa1a9dd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.620321 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e0d20-99c4-46f8-9c53-207aa1a9dd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.621928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e0d20-99c4-46f8-9c53-207aa1a9dd33 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.623686 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 774/1570] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:08:34.624616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ea58c-aac1-42de-a46c-05e7493beaf7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.633673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ea58c-aac1-42de-a46c-05e7493beaf7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.635421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 797/1571] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:34 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:34.636197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e0d20-99c4-46f8-9c53-207aa1a9dd33 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.641377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c40a9-c2ee-4e1f-871f-af3b4b070c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.642011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c40a9-c2ee-4e1f-871f-af3b4b070c76 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.642294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c40a9-c2ee-4e1f-871f-af3b4b070c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.642600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c40a9-c2ee-4e1f-871f-af3b4b070c76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.643287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c40a9-c2ee-4e1f-871f-af3b4b070c76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.645157 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c40a9-c2ee-4e1f-871f-af3b4b070c76 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.645856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e0d20-99c4-46f8-9c53-207aa1a9dd33 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.650499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59aa0c7-8e66-46da-b151-8793eebc947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.651130 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59aa0c7-8e66-46da-b151-8793eebc947f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.651416 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59aa0c7-8e66-46da-b151-8793eebc947f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.651697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59aa0c7-8e66-46da-b151-8793eebc947f admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.652468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59aa0c7-8e66-46da-b151-8793eebc947f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:08:34.652778 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59aa0c7-8e66-46da-b151-8793eebc947f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.654801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59aa0c7-8e66-46da-b151-8793eebc947f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.666947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 798/1572] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:08:34.667769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59aa0c7-8e66-46da-b151-8793eebc947f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.673807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 775/1573] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:34.673807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c40a9-c2ee-4e1f-871f-af3b4b070c76 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.684249 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59aa0c7-8e66-46da-b151-8793eebc947f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.736886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c40a9-c2ee-4e1f-871f-af3b4b070c76 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.739240 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6faf4-02d2-4863-b43f-a5fcc8114088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.739916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6faf4-02d2-4863-b43f-a5fcc8114088 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.740204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6faf4-02d2-4863-b43f-a5fcc8114088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.740482 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6faf4-02d2-4863-b43f-a5fcc8114088 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.741186 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6faf4-02d2-4863-b43f-a5fcc8114088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.741793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef7693-3e8a-4eba-8f70-cd45a47142d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.742464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef7693-3e8a-4eba-8f70-cd45a47142d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.742747 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef7693-3e8a-4eba-8f70-cd45a47142d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.743021 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef7693-3e8a-4eba-8f70-cd45a47142d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.743161 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6faf4-02d2-4863-b43f-a5fcc8114088 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.743744 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef7693-3e8a-4eba-8f70-cd45a47142d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:08:34.744047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef7693-3e8a-4eba-8f70-cd45a47142d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.745874 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef7693-3e8a-4eba-8f70-cd45a47142d2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.758238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 776/1574] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:08:34.759264 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef7693-3e8a-4eba-8f70-cd45a47142d2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.763913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 799/1575] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:34.767313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6faf4-02d2-4863-b43f-a5fcc8114088 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.777791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef7693-3e8a-4eba-8f70-cd45a47142d2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.779431 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6faf4-02d2-4863-b43f-a5fcc8114088 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.783555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fac95-d9b1-4b7d-9676-282600521af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.784214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fac95-d9b1-4b7d-9676-282600521af2 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.784529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fac95-d9b1-4b7d-9676-282600521af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.784893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fac95-d9b1-4b7d-9676-282600521af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.785702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fac95-d9b1-4b7d-9676-282600521af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.787667 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fac95-d9b1-4b7d-9676-282600521af2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.788384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a3449-f47e-436e-bf2e-a8f8eecc454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.789207 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a3449-f47e-436e-bf2e-a8f8eecc454f admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.789731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a3449-f47e-436e-bf2e-a8f8eecc454f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.790264 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a3449-f47e-436e-bf2e-a8f8eecc454f admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.791711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a3449-f47e-436e-bf2e-a8f8eecc454f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.793984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a3449-f47e-436e-bf2e-a8f8eecc454f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.815324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 800/1576] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/users => generated 296 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:34.816648 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a3449-f47e-436e-bf2e-a8f8eecc454f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.816763 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 777/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:34.817321 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fac95-d9b1-4b7d-9676-282600521af2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.828532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a3449-f47e-436e-bf2e-a8f8eecc454f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.883775 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fac95-d9b1-4b7d-9676-282600521af2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.885662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d34781-4b5a-4fb4-975e-a276ab22cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.886324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d34781-4b5a-4fb4-975e-a276ab22cb8f admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.886641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d34781-4b5a-4fb4-975e-a276ab22cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.886923 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d34781-4b5a-4fb4-975e-a276ab22cb8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.887661 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d34781-4b5a-4fb4-975e-a276ab22cb8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.888958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4934a9b-e8f1-4601-9b86-83aeee89ef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.889845 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4934a9b-e8f1-4601-9b86-83aeee89ef4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.890129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4934a9b-e8f1-4601-9b86-83aeee89ef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.890252 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d34781-4b5a-4fb4-975e-a276ab22cb8f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.890443 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4934a9b-e8f1-4601-9b86-83aeee89ef4a admin admin] PATH_INFO: `/v3/projects/56cc5206654a42b099c26d99bcfee94f/users/046d3c176330479e99bc839aa1c5f213/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.905444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4934a9b-e8f1-4601-9b86-83aeee89ef4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cc5206654a42b099c26d99bcfee94f, user_id=046d3c176330479e99bc839aa1c5f213, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.908337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4934a9b-e8f1-4601-9b86-83aeee89ef4a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:34.917419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 801/1578] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:34.921348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 778/1579] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:34 2021] PUT /identity/v3/projects/56cc5206654a42b099c26d99bcfee94f/users/046d3c176330479e99bc839aa1c5f213/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:34.922131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d34781-4b5a-4fb4-975e-a276ab22cb8f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.922265 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4934a9b-e8f1-4601-9b86-83aeee89ef4a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:34.990754 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d34781-4b5a-4fb4-975e-a276ab22cb8f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.994413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4934a9b-e8f1-4601-9b86-83aeee89ef4a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:34.995435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8c7e5-320f-4dcc-a4da-0ae28beeff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:34.996098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8c7e5-320f-4dcc-a4da-0ae28beeff84 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:34.996382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8c7e5-320f-4dcc-a4da-0ae28beeff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:34.996655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8c7e5-320f-4dcc-a4da-0ae28beeff84 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:34.998124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8c7e5-320f-4dcc-a4da-0ae28beeff84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:34.999849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5b70d-83b4-49ff-a9bc-a1bf99182bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.000124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8c7e5-320f-4dcc-a4da-0ae28beeff84 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.000521 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5b70d-83b4-49ff-a9bc-a1bf99182bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.000809 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5b70d-83b4-49ff-a9bc-a1bf99182bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.001086 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5b70d-83b4-49ff-a9bc-a1bf99182bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.001786 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5b70d-83b4-49ff-a9bc-a1bf99182bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.003803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5b70d-83b4-49ff-a9bc-a1bf99182bb5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.024657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 802/1580] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:35.024657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8c7e5-320f-4dcc-a4da-0ae28beeff84 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.032082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 779/1581] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:34 2021] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:35.032275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8c7e5-320f-4dcc-a4da-0ae28beeff84 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.032791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5b70d-83b4-49ff-a9bc-a1bf99182bb5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.092212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64e86e-3070-474a-be58-93a94eac03d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.092876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64e86e-3070-474a-be58-93a94eac03d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.093156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64e86e-3070-474a-be58-93a94eac03d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.093430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64e86e-3070-474a-be58-93a94eac03d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.093536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5b70d-83b4-49ff-a9bc-a1bf99182bb5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.094139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64e86e-3070-474a-be58-93a94eac03d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.096233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64e86e-3070-474a-be58-93a94eac03d4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.099123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3c004-40ca-4ecd-b692-cade4caa53a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.100278 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c004-40ca-4ecd-b692-cade4caa53a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.100770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c004-40ca-4ecd-b692-cade4caa53a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.101258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c004-40ca-4ecd-b692-cade4caa53a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.102634 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3c004-40ca-4ecd-b692-cade4caa53a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.104720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3c004-40ca-4ecd-b692-cade4caa53a6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.116630 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 780/1582] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.118024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3c004-40ca-4ecd-b692-cade4caa53a6 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.128449 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 803/1583] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:35 2021] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:35.129165 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64e86e-3070-474a-be58-93a94eac03d4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.130330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3c004-40ca-4ecd-b692-cade4caa53a6 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.187461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20cc52-9243-4423-8b07-9dc0fab18d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.188040 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20cc52-9243-4423-8b07-9dc0fab18d29 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.188316 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20cc52-9243-4423-8b07-9dc0fab18d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.188596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20cc52-9243-4423-8b07-9dc0fab18d29 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.189299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20cc52-9243-4423-8b07-9dc0fab18d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.191266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20cc52-9243-4423-8b07-9dc0fab18d29 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.193637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64e86e-3070-474a-be58-93a94eac03d4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.198555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d5135-b914-4bc8-85f9-4ad88d69b4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.199235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d5135-b914-4bc8-85f9-4ad88d69b4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.199962 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d5135-b914-4bc8-85f9-4ad88d69b4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.201202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d5135-b914-4bc8-85f9-4ad88d69b4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.202052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d5135-b914-4bc8-85f9-4ad88d69b4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.203905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d5135-b914-4bc8-85f9-4ad88d69b4c0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.214492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 781/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:35 2021] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:35.214492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20cc52-9243-4423-8b07-9dc0fab18d29 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.215428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 804/1585] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.217485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc664e5-69ee-4b63-85cc-453414a8f845 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.218077 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc664e5-69ee-4b63-85cc-453414a8f845 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.218213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc664e5-69ee-4b63-85cc-453414a8f845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.223022 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20cc52-9243-4423-8b07-9dc0fab18d29 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.227618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b41102-f54e-4143-9172-b5448e744853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.228260 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b41102-f54e-4143-9172-b5448e744853 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.228540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b41102-f54e-4143-9172-b5448e744853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.228817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b41102-f54e-4143-9172-b5448e744853 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.229499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b41102-f54e-4143-9172-b5448e744853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.232945 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b41102-f54e-4143-9172-b5448e744853 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.247855 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-fdc664e5-69ee-4b63-85cc-453414a8f845 None None] MFA Rules not processed for user `046d3c176330479e99bc839aa1c5f213`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:35.249148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fdc664e5-69ee-4b63-85cc-453414a8f845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:35.253021 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 782/1586] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:35 2021] POST /identity/v3/users => generated 284 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:35.256794 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b41102-f54e-4143-9172-b5448e744853 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.265928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b41102-f54e-4143-9172-b5448e744853 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.270633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb136b9-41c5-4780-8525-5d9a98cb58a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.271166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb136b9-41c5-4780-8525-5d9a98cb58a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.271444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb136b9-41c5-4780-8525-5d9a98cb58a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.271786 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb136b9-41c5-4780-8525-5d9a98cb58a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.272523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb136b9-41c5-4780-8525-5d9a98cb58a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.274112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb136b9-41c5-4780-8525-5d9a98cb58a6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.284461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 783/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.285043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb136b9-41c5-4780-8525-5d9a98cb58a6 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.295799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb136b9-41c5-4780-8525-5d9a98cb58a6 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.300500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185118-dfc9-4b1e-bd92-1aaa8a7f3b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.301144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185118-dfc9-4b1e-bd92-1aaa8a7f3b23 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.301423 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185118-dfc9-4b1e-bd92-1aaa8a7f3b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.301702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185118-dfc9-4b1e-bd92-1aaa8a7f3b23 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.302425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8185118-dfc9-4b1e-bd92-1aaa8a7f3b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.304371 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8185118-dfc9-4b1e-bd92-1aaa8a7f3b23 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.313959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 805/1588] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:35 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:35.315130 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc664e5-69ee-4b63-85cc-453414a8f845 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.327605 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 784/1589] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:35 2021] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:35.327605 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185118-dfc9-4b1e-bd92-1aaa8a7f3b23 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.327863 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc664e5-69ee-4b63-85cc-453414a8f845 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.330916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01903920-a6f1-4a8d-b4c5-149bac0baa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.331587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01903920-a6f1-4a8d-b4c5-149bac0baa27 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.331865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01903920-a6f1-4a8d-b4c5-149bac0baa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.332140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01903920-a6f1-4a8d-b4c5-149bac0baa27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.332878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01903920-a6f1-4a8d-b4c5-149bac0baa27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.334652 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01903920-a6f1-4a8d-b4c5-149bac0baa27 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.335404 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185118-dfc9-4b1e-bd92-1aaa8a7f3b23 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.339962 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bc2fc-b8f4-47e4-89e7-58274904ae18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.340652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc2fc-b8f4-47e4-89e7-58274904ae18 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.341130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc2fc-b8f4-47e4-89e7-58274904ae18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.341417 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc2fc-b8f4-47e4-89e7-58274904ae18 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.342271 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bc2fc-b8f4-47e4-89e7-58274904ae18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.344243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bc2fc-b8f4-47e4-89e7-58274904ae18 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.344719 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 806/1590] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.345502 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01903920-a6f1-4a8d-b4c5-149bac0baa27 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.355588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01903920-a6f1-4a8d-b4c5-149bac0baa27 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.361240 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f23ce0-7df2-4891-aae6-47d753170306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.361927 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f23ce0-7df2-4891-aae6-47d753170306 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.362202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f23ce0-7df2-4891-aae6-47d753170306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.362517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f23ce0-7df2-4891-aae6-47d753170306 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.363239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f23ce0-7df2-4891-aae6-47d753170306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.364806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f23ce0-7df2-4891-aae6-47d753170306 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.366030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 785/1591] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:35 2021] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:35.366855 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bc2fc-b8f4-47e4-89e7-58274904ae18 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.376057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 807/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.376948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f23ce0-7df2-4891-aae6-47d753170306 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.377261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bc2fc-b8f4-47e4-89e7-58274904ae18 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.384756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3dd7b-a16f-474b-9e71-ec9deaa9ea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.385465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3dd7b-a16f-474b-9e71-ec9deaa9ea92 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.385789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3dd7b-a16f-474b-9e71-ec9deaa9ea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.386069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3dd7b-a16f-474b-9e71-ec9deaa9ea92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.386924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3dd7b-a16f-474b-9e71-ec9deaa9ea92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.388676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3dd7b-a16f-474b-9e71-ec9deaa9ea92 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.390063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f23ce0-7df2-4891-aae6-47d753170306 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.394558 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a936f3-680a-4cc9-ae65-6b13aacbb7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.395194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a936f3-680a-4cc9-ae65-6b13aacbb7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.395473 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a936f3-680a-4cc9-ae65-6b13aacbb7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.395749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a936f3-680a-4cc9-ae65-6b13aacbb7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.396496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a936f3-680a-4cc9-ae65-6b13aacbb7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.398170 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a936f3-680a-4cc9-ae65-6b13aacbb7d3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.400852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 786/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.403322 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3dd7b-a16f-474b-9e71-ec9deaa9ea92 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.411037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 808/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.411037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a936f3-680a-4cc9-ae65-6b13aacbb7d3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.413601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3dd7b-a16f-474b-9e71-ec9deaa9ea92 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.417974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a936f3-680a-4cc9-ae65-6b13aacbb7d3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.418491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a7515-6985-4078-a2ae-144d0f8ec04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.419673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a7515-6985-4078-a2ae-144d0f8ec04a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.419989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a7515-6985-4078-a2ae-144d0f8ec04a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.420378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a7515-6985-4078-a2ae-144d0f8ec04a admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.421109 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a7515-6985-4078-a2ae-144d0f8ec04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.422706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a7515-6985-4078-a2ae-144d0f8ec04a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.423017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a49948-fce3-4ac6-abfd-65bcc4fead05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.423639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a49948-fce3-4ac6-abfd-65bcc4fead05 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.423921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a49948-fce3-4ac6-abfd-65bcc4fead05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.424195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a49948-fce3-4ac6-abfd-65bcc4fead05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.424884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a49948-fce3-4ac6-abfd-65bcc4fead05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.426757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a49948-fce3-4ac6-abfd-65bcc4fead05 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.432524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 787/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.433399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a7515-6985-4078-a2ae-144d0f8ec04a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.443945 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a7515-6985-4078-a2ae-144d0f8ec04a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.448708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4ad09-c0d4-49f3-aa7d-b956dd4ec192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.449347 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ad09-c0d4-49f3-aa7d-b956dd4ec192 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.449631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ad09-c0d4-49f3-aa7d-b956dd4ec192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.449919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ad09-c0d4-49f3-aa7d-b956dd4ec192 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.450690 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4ad09-c0d4-49f3-aa7d-b956dd4ec192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.455128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 809/1596] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:35 2021] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:35.455329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4ad09-c0d4-49f3-aa7d-b956dd4ec192 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.455432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a49948-fce3-4ac6-abfd-65bcc4fead05 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.461993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 788/1597] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.462794 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4ad09-c0d4-49f3-aa7d-b956dd4ec192 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.476082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4ad09-c0d4-49f3-aa7d-b956dd4ec192 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.513344 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a49948-fce3-4ac6-abfd-65bcc4fead05 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.518034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5bbf3-720c-47b7-aa85-985a2fb73423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.518959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5bbf3-720c-47b7-aa85-985a2fb73423 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.519256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5bbf3-720c-47b7-aa85-985a2fb73423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.519514 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5bbf3-720c-47b7-aa85-985a2fb73423 admin admin] PATH_INFO: `/v3/projects/7c550961fe9c4d39a948a838a3c7f6a9/users/0f38c905a91d453a8f971a84cc523a5b/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.533770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5bbf3-720c-47b7-aa85-985a2fb73423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c550961fe9c4d39a948a838a3c7f6a9, user_id=0f38c905a91d453a8f971a84cc523a5b, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.534656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b77f1-2239-4131-aedf-ee64ef78e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.535470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b77f1-2239-4131-aedf-ee64ef78e927 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.535757 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b77f1-2239-4131-aedf-ee64ef78e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.536031 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b77f1-2239-4131-aedf-ee64ef78e927 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.536445 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5bbf3-720c-47b7-aa85-985a2fb73423 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.536799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b77f1-2239-4131-aedf-ee64ef78e927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.538380 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b77f1-2239-4131-aedf-ee64ef78e927 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.548788 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 789/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.549612 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b77f1-2239-4131-aedf-ee64ef78e927 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.562234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 810/1599] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:35 2021] PUT /identity/v3/projects/7c550961fe9c4d39a948a838a3c7f6a9/users/0f38c905a91d453a8f971a84cc523a5b/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:35.562234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5bbf3-720c-47b7-aa85-985a2fb73423 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.562572 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b77f1-2239-4131-aedf-ee64ef78e927 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.616717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5bbf3-720c-47b7-aa85-985a2fb73423 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.618096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feba941-9a95-482d-94e8-9fd7ae212aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.618963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feba941-9a95-482d-94e8-9fd7ae212aea admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.619251 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feba941-9a95-482d-94e8-9fd7ae212aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.619531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feba941-9a95-482d-94e8-9fd7ae212aea admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.620262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feba941-9a95-482d-94e8-9fd7ae212aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.621771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daa3db-a31f-4cc6-8358-d5835a9f7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.621913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feba941-9a95-482d-94e8-9fd7ae212aea admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.623451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daa3db-a31f-4cc6-8358-d5835a9f7132 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.623770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daa3db-a31f-4cc6-8358-d5835a9f7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.624029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daa3db-a31f-4cc6-8358-d5835a9f7132 admin admin] PATH_INFO: `/v3/projects/f142a63d748e48d08bff8bfeeb533566/users/d5ff623eda804e5980eee894d43cdc2e/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.632198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 790/1600] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.633276 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feba941-9a95-482d-94e8-9fd7ae212aea admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.642462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daa3db-a31f-4cc6-8358-d5835a9f7132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f142a63d748e48d08bff8bfeeb533566, user_id=d5ff623eda804e5980eee894d43cdc2e, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.643219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feba941-9a95-482d-94e8-9fd7ae212aea admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.645129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daa3db-a31f-4cc6-8358-d5835a9f7132 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.647873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bd5f3-f412-4a3c-b008-2e749f93866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.648517 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bd5f3-f412-4a3c-b008-2e749f93866f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.648920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bd5f3-f412-4a3c-b008-2e749f93866f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.649204 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bd5f3-f412-4a3c-b008-2e749f93866f admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.649961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bd5f3-f412-4a3c-b008-2e749f93866f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.651548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bd5f3-f412-4a3c-b008-2e749f93866f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.659591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 811/1601] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:35 2021] PUT /identity/v3/projects/f142a63d748e48d08bff8bfeeb533566/users/d5ff623eda804e5980eee894d43cdc2e/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:35.660527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daa3db-a31f-4cc6-8358-d5835a9f7132 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.664187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 791/1602] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.664187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bd5f3-f412-4a3c-b008-2e749f93866f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.673527 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bd5f3-f412-4a3c-b008-2e749f93866f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.723942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daa3db-a31f-4cc6-8358-d5835a9f7132 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.728409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccf690-21cc-4070-8221-31273b40119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.729285 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccf690-21cc-4070-8221-31273b40119d admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.729578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccf690-21cc-4070-8221-31273b40119d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.729844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccf690-21cc-4070-8221-31273b40119d admin admin] PATH_INFO: `/v3/projects/d3f9e76c59a14a3eb6fbb1140ba4a22c/users/fbf2cc7ed59f434e864560cd2ca8e3fe/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.730433 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b4fab-0b76-42a5-8109-e0d68266856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.731117 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b4fab-0b76-42a5-8109-e0d68266856c admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.731426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b4fab-0b76-42a5-8109-e0d68266856c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.731701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b4fab-0b76-42a5-8109-e0d68266856c admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.732415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b4fab-0b76-42a5-8109-e0d68266856c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.734477 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b4fab-0b76-42a5-8109-e0d68266856c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.744019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccf690-21cc-4070-8221-31273b40119d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f9e76c59a14a3eb6fbb1140ba4a22c, user_id=fbf2cc7ed59f434e864560cd2ca8e3fe, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.747609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccf690-21cc-4070-8221-31273b40119d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.760397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 792/1603] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:35 2021] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:35.760397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b4fab-0b76-42a5-8109-e0d68266856c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.764245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 812/1604] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:35 2021] PUT /identity/v3/projects/d3f9e76c59a14a3eb6fbb1140ba4a22c/users/fbf2cc7ed59f434e864560cd2ca8e3fe/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:35.765068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccf690-21cc-4070-8221-31273b40119d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.768706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b4fab-0b76-42a5-8109-e0d68266856c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.824721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38e65b-336f-45dc-9240-d0d1b0c4cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.825925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38e65b-336f-45dc-9240-d0d1b0c4cfce admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.826205 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38e65b-336f-45dc-9240-d0d1b0c4cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.826515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38e65b-336f-45dc-9240-d0d1b0c4cfce admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.827253 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38e65b-336f-45dc-9240-d0d1b0c4cfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.828835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38e65b-336f-45dc-9240-d0d1b0c4cfce admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.833469 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccf690-21cc-4070-8221-31273b40119d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.838029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b11f80-b1e9-4b1d-86df-e17def7abc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.838814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 793/1605] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.838984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11f80-b1e9-4b1d-86df-e17def7abc7e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.839171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11f80-b1e9-4b1d-86df-e17def7abc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.839439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11f80-b1e9-4b1d-86df-e17def7abc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.840222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b11f80-b1e9-4b1d-86df-e17def7abc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.842191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b11f80-b1e9-4b1d-86df-e17def7abc7e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.842623 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a28156-67c4-44bb-ba40-15ded25ac5c2 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.843085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a28156-67c4-44bb-ba40-15ded25ac5c2 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.843387 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a28156-67c4-44bb-ba40-15ded25ac5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.852898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 813/1606] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:35.853728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b11f80-b1e9-4b1d-86df-e17def7abc7e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.863224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b11f80-b1e9-4b1d-86df-e17def7abc7e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.868146 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6f3df-98ab-489b-abe9-31c40bd6c339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.869020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f3df-98ab-489b-abe9-31c40bd6c339 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.869306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f3df-98ab-489b-abe9-31c40bd6c339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.869584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f3df-98ab-489b-abe9-31c40bd6c339 admin admin] PATH_INFO: `/v3/projects/853a8a131b9d4f239bc6b9dc03642f2e/users/62defd8645f7454699ee5c7bb5930d16/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.873670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c9a28156-67c4-44bb-ba40-15ded25ac5c2 None None] MFA Rules not processed for user `0f38c905a91d453a8f971a84cc523a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:35.874933 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c9a28156-67c4-44bb-ba40-15ded25ac5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:35.884606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6f3df-98ab-489b-abe9-31c40bd6c339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853a8a131b9d4f239bc6b9dc03642f2e, user_id=62defd8645f7454699ee5c7bb5930d16, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.887394 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6f3df-98ab-489b-abe9-31c40bd6c339 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:35.901052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 814/1607] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:35 2021] PUT /identity/v3/projects/853a8a131b9d4f239bc6b9dc03642f2e/users/62defd8645f7454699ee5c7bb5930d16/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:35.902551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856ed19-351e-46ac-9936-51353b2fa39f None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.902838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856ed19-351e-46ac-9936-51353b2fa39f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.903157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856ed19-351e-46ac-9936-51353b2fa39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.919245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2856ed19-351e-46ac-9936-51353b2fa39f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:35.920444 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2856ed19-351e-46ac-9936-51353b2fa39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:35.942312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 794/1608] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:35 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:35.943356 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a28156-67c4-44bb-ba40-15ded25ac5c2 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.953966 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a28156-67c4-44bb-ba40-15ded25ac5c2 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.980288 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 815/1609] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:35.981062 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856ed19-351e-46ac-9936-51353b2fa39f None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:35.990274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856ed19-351e-46ac-9936-51353b2fa39f None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:35.995181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e1f6d-a342-4345-b66b-ceef1748db93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:35.995833 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e1f6d-a342-4345-b66b-ceef1748db93 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:35.996166 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e1f6d-a342-4345-b66b-ceef1748db93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:35.996446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e1f6d-a342-4345-b66b-ceef1748db93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:35.997212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e1f6d-a342-4345-b66b-ceef1748db93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:35.998872 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e1f6d-a342-4345-b66b-ceef1748db93 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.008567 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 816/1610] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:36.009773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e79f5-e041-4f2f-8b98-c1e5c1a2a4a7 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.010057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e79f5-e041-4f2f-8b98-c1e5c1a2a4a7 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.010338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e79f5-e041-4f2f-8b98-c1e5c1a2a4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.011748 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab732458-7658-4a64-9e90-2dd1613dd203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.013302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab732458-7658-4a64-9e90-2dd1613dd203 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.013720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab732458-7658-4a64-9e90-2dd1613dd203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.013996 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab732458-7658-4a64-9e90-2dd1613dd203 admin admin] PATH_INFO: `/v3/projects/39d572b3d19c4047b134e4f416b9e46e/users/d1ff457678b4427b8db04aea3990a150/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.028665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab732458-7658-4a64-9e90-2dd1613dd203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d572b3d19c4047b134e4f416b9e46e, user_id=d1ff457678b4427b8db04aea3990a150, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:36.031365 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab732458-7658-4a64-9e90-2dd1613dd203 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.036684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-7f0e79f5-e041-4f2f-8b98-c1e5c1a2a4a7 None None] MFA Rules not processed for user `fbf2cc7ed59f434e864560cd2ca8e3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:36.037921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-7f0e79f5-e041-4f2f-8b98-c1e5c1a2a4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:36.044854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 795/1611] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:35 2021] PUT /identity/v3/projects/39d572b3d19c4047b134e4f416b9e46e/users/d1ff457678b4427b8db04aea3990a150/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:36.045970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab732458-7658-4a64-9e90-2dd1613dd203 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:36.102339 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 817/1612] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:36 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:36.103560 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e79f5-e041-4f2f-8b98-c1e5c1a2a4a7 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:36.108534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab732458-7658-4a64-9e90-2dd1613dd203 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:36.113354 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a9552-e03a-40a7-bad6-54859e4457b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.114460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9552-e03a-40a7-bad6-54859e4457b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.114820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9552-e03a-40a7-bad6-54859e4457b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.115235 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9552-e03a-40a7-bad6-54859e4457b6 admin admin] PATH_INFO: `/v3/projects/f6f062a4353046c9a44957550c394c9d/users/59d2b98f1809405ab307a035062400c2/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.116471 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e79f5-e041-4f2f-8b98-c1e5c1a2a4a7 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:36.121884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba967e-2e48-47ec-8f68-25e496c8a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.122969 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba967e-2e48-47ec-8f68-25e496c8a056 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.123254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba967e-2e48-47ec-8f68-25e496c8a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.123530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba967e-2e48-47ec-8f68-25e496c8a056 admin admin] PATH_INFO: `/v3/projects/f744683c3f364dda933c885766c8dfec/users/98b74ad2c40f4a7caf926c7954046137/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.130919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a9552-e03a-40a7-bad6-54859e4457b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f062a4353046c9a44957550c394c9d, user_id=59d2b98f1809405ab307a035062400c2, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:36.133641 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a9552-e03a-40a7-bad6-54859e4457b6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.138765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba967e-2e48-47ec-8f68-25e496c8a056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f744683c3f364dda933c885766c8dfec, user_id=98b74ad2c40f4a7caf926c7954046137, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:36.141404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba967e-2e48-47ec-8f68-25e496c8a056 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.153432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 796/1613] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:36 2021] PUT /identity/v3/projects/f6f062a4353046c9a44957550c394c9d/users/59d2b98f1809405ab307a035062400c2/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:36.155487 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be92f-d02d-4b5d-a478-9a806d7f25bd None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.155487 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be92f-d02d-4b5d-a478-9a806d7f25bd None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.156127 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be92f-d02d-4b5d-a478-9a806d7f25bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.161419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 818/1614] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:36 2021] PUT /identity/v3/projects/f744683c3f364dda933c885766c8dfec/users/98b74ad2c40f4a7caf926c7954046137/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:36.161419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1d4a3-c371-454c-8dbb-42da9271cfdd None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.161419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1d4a3-c371-454c-8dbb-42da9271cfdd None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.161419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1d4a3-c371-454c-8dbb-42da9271cfdd None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.162959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 819/1615] 10.222.0.23 () {54 vars in 961 bytes} [Thu Dec 9 01:08:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:08:36.167968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1d4a3-c371-454c-8dbb-42da9271cfdd None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:36.175362 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-575be92f-d02d-4b5d-a478-9a806d7f25bd None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:36.176631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-575be92f-d02d-4b5d-a478-9a806d7f25bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:36.222771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1d4a3-c371-454c-8dbb-42da9271cfdd None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:36.226519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a57eda-9672-47c3-8339-c47f1ad170ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.227271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a57eda-9672-47c3-8339-c47f1ad170ce service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.227658 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a57eda-9672-47c3-8339-c47f1ad170ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.228036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a57eda-9672-47c3-8339-c47f1ad170ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.233663 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 797/1616] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:36.234422 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be92f-d02d-4b5d-a478-9a806d7f25bd None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:36.238822 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a57eda-9672-47c3-8339-c47f1ad170ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:36.240905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a57eda-9672-47c3-8339-c47f1ad170ce service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.243600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be92f-d02d-4b5d-a478-9a806d7f25bd None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:36.249550 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11707874-9a65-4cee-b466-6c0f6694a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.250450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11707874-9a65-4cee-b466-6c0f6694a242 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.250740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11707874-9a65-4cee-b466-6c0f6694a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.251019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11707874-9a65-4cee-b466-6c0f6694a242 admin admin] PATH_INFO: `/v3/projects/5ef475269dfd451fb26bfe4394ce7a89/users/a8abcf0db1b24c0b8b3f254ff2718e7c/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.251990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 820/1617] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:36.253374 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456cd2c-6a23-460f-8d47-ab784fcc9397 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.253672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456cd2c-6a23-460f-8d47-ab784fcc9397 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.253954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456cd2c-6a23-460f-8d47-ab784fcc9397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.273461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11707874-9a65-4cee-b466-6c0f6694a242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef475269dfd451fb26bfe4394ce7a89, user_id=a8abcf0db1b24c0b8b3f254ff2718e7c, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:36.277657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11707874-9a65-4cee-b466-6c0f6694a242 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.284013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-0456cd2c-6a23-460f-8d47-ab784fcc9397 None None] MFA Rules not processed for user `d1ff457678b4427b8db04aea3990a150`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:36.285526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0456cd2c-6a23-460f-8d47-ab784fcc9397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:36.295870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 798/1618] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:36 2021] PUT /identity/v3/projects/5ef475269dfd451fb26bfe4394ce7a89/users/a8abcf0db1b24c0b8b3f254ff2718e7c/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:36.297832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e4cb2-d135-4616-a0a9-94716f01d9f3 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.298322 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e4cb2-d135-4616-a0a9-94716f01d9f3 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.298939 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e4cb2-d135-4616-a0a9-94716f01d9f3 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.301146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 799/1619] 10.222.0.23 () {54 vars in 961 bytes} [Thu Dec 9 01:08:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:08:36.306816 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7521b-2cf0-4707-a962-ed1de42b723e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.307189 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7521b-2cf0-4707-a962-ed1de42b723e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.307555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7521b-2cf0-4707-a962-ed1de42b723e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.326938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-cfb7521b-2cf0-4707-a962-ed1de42b723e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:36.328216 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-cfb7521b-2cf0-4707-a962-ed1de42b723e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:36.364062 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 821/1620] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:36 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:36.365382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94cb6b-e5ab-4a93-9c36-0bf1a150eb29 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.365673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94cb6b-e5ab-4a93-9c36-0bf1a150eb29 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.366018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94cb6b-e5ab-4a93-9c36-0bf1a150eb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.385020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-0d94cb6b-e5ab-4a93-9c36-0bf1a150eb29 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:36.386218 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0d94cb6b-e5ab-4a93-9c36-0bf1a150eb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:36.397866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 800/1621] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:36.399371 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b0c7e-323e-463a-8437-6047f9c459e7 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.399761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b0c7e-323e-463a-8437-6047f9c459e7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.400136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b0c7e-323e-463a-8437-6047f9c459e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.424739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-5c1b0c7e-323e-463a-8437-6047f9c459e7 None None] MFA Rules not processed for user `53d32ba063bc4a719d4c2f67d88ec640`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:36.426511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5c1b0c7e-323e-463a-8437-6047f9c459e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:36.458017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 822/1622] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:36.458017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94cb6b-e5ab-4a93-9c36-0bf1a150eb29 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:36.526015 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 801/1623] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Dec 9 01:08:36 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:36.532219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b0c7e-323e-463a-8437-6047f9c459e7 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:36.532435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94cb6b-e5ab-4a93-9c36-0bf1a150eb29 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:36.533603 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb302-faf0-45af-9611-886830496776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.534305 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb302-faf0-45af-9611-886830496776 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.534642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb302-faf0-45af-9611-886830496776 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.534945 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb302-faf0-45af-9611-886830496776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.539276 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b0c7e-323e-463a-8437-6047f9c459e7 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:36.548210 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cea9d7-7422-4cb9-86a5-8afc3f1e0962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.548880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb302-faf0-45af-9611-886830496776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:36.549117 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cea9d7-7422-4cb9-86a5-8afc3f1e0962 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.549572 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cea9d7-7422-4cb9-86a5-8afc3f1e0962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.549979 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cea9d7-7422-4cb9-86a5-8afc3f1e0962 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.550768 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb302-faf0-45af-9611-886830496776 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.551102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cea9d7-7422-4cb9-86a5-8afc3f1e0962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:36.553677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cea9d7-7422-4cb9-86a5-8afc3f1e0962 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.561431 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 823/1624] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:36.562611 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ab9b2-f9ff-4248-92dd-208d2032685b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.562896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ab9b2-f9ff-4248-92dd-208d2032685b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.563173 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ab9b2-f9ff-4248-92dd-208d2032685b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.565993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 802/1625] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:36 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:36.566941 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cea9d7-7422-4cb9-86a5-8afc3f1e0962 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:36.587300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-113ab9b2-f9ff-4248-92dd-208d2032685b None None] MFA Rules not processed for user `53d32ba063bc4a719d4c2f67d88ec640`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:36.588710 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-113ab9b2-f9ff-4248-92dd-208d2032685b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:36.600964 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 824/1626] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Dec 9 01:08:36 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:36.601993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ab9b2-f9ff-4248-92dd-208d2032685b None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:36.603401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-113ab9b2-f9ff-4248-92dd-208d2032685b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:36.617152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ab9b2-f9ff-4248-92dd-208d2032685b None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:36.621506 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0700411-dbc5-430d-9023-7cfd89abf2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.622911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0700411-dbc5-430d-9023-7cfd89abf2cc service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.623300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0700411-dbc5-430d-9023-7cfd89abf2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.623676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0700411-dbc5-430d-9023-7cfd89abf2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.634263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0700411-dbc5-430d-9023-7cfd89abf2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:36.635900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0700411-dbc5-430d-9023-7cfd89abf2cc service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.638621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cea9d7-7422-4cb9-86a5-8afc3f1e0962 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:36.642715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bea5c4-7c95-4f0c-afeb-6001b56918e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.643359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bea5c4-7c95-4f0c-afeb-6001b56918e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.643639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bea5c4-7c95-4f0c-afeb-6001b56918e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.643917 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bea5c4-7c95-4f0c-afeb-6001b56918e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.646575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 825/1627] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:36.647952 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0700411-dbc5-430d-9023-7cfd89abf2cc service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:36.656958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0700411-dbc5-430d-9023-7cfd89abf2cc service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:36.661324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b31f26-0973-4797-918f-ab68780885c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.662121 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b31f26-0973-4797-918f-ab68780885c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.662583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b31f26-0973-4797-918f-ab68780885c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.663003 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b31f26-0973-4797-918f-ab68780885c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.675573 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b31f26-0973-4797-918f-ab68780885c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:36.677474 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b31f26-0973-4797-918f-ab68780885c8 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.694614 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 826/1628] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:36.696092 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b31f26-0973-4797-918f-ab68780885c8 service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:36.713101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b31f26-0973-4797-918f-ab68780885c8 service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:36.715133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bea5c4-7c95-4f0c-afeb-6001b56918e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:36.717270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bea5c4-7c95-4f0c-afeb-6001b56918e7 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.720642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bd0f5-0783-4ffc-b44f-df0d3f161ebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.721779 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bd0f5-0783-4ffc-b44f-df0d3f161ebc service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.722377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bd0f5-0783-4ffc-b44f-df0d3f161ebc service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.722672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bd0f5-0783-4ffc-b44f-df0d3f161ebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.727072 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 803/1629] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:36 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:36.727889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bea5c4-7c95-4f0c-afeb-6001b56918e7 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:36.738785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bea5c4-7c95-4f0c-afeb-6001b56918e7 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:36.745075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568050-4bbf-43c9-b4a4-a4bec506a7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.746017 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568050-4bbf-43c9-b4a4-a4bec506a7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.746302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568050-4bbf-43c9-b4a4-a4bec506a7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.746598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568050-4bbf-43c9-b4a4-a4bec506a7b2 admin admin] PATH_INFO: `/v3/projects/5ef475269dfd451fb26bfe4394ce7a89/users/a8abcf0db1b24c0b8b3f254ff2718e7c/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.750562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48568050-4bbf-43c9-b4a4-a4bec506a7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef475269dfd451fb26bfe4394ce7a89, user_id=a8abcf0db1b24c0b8b3f254ff2718e7c, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:36.754322 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48568050-4bbf-43c9-b4a4-a4bec506a7b2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.769769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 804/1630] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:36 2021] PUT /identity/v3/projects/5ef475269dfd451fb26bfe4394ce7a89/users/a8abcf0db1b24c0b8b3f254ff2718e7c/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:36.770833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568050-4bbf-43c9-b4a4-a4bec506a7b2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:36.824471 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bd0f5-0783-4ffc-b44f-df0d3f161ebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:36.827291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bd0f5-0783-4ffc-b44f-df0d3f161ebc service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:36.838896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 827/1631] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:36 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:36.840890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714cc97-6f87-44a5-a179-d8974be30b3c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.841287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714cc97-6f87-44a5-a179-d8974be30b3c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.841670 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714cc97-6f87-44a5-a179-d8974be30b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.882000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2714cc97-6f87-44a5-a179-d8974be30b3c None None] MFA Rules not processed for user `a8abcf0db1b24c0b8b3f254ff2718e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:36.883139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2714cc97-6f87-44a5-a179-d8974be30b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:36.951198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568050-4bbf-43c9-b4a4-a4bec506a7b2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:36.963106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 828/1632] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:36 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:36.972375 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3215b20-cc1c-4bfb-b4a7-40a472dcde8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:36.973103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3215b20-cc1c-4bfb-b4a7-40a472dcde8f service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:36.973384 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3215b20-cc1c-4bfb-b4a7-40a472dcde8f service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:36.973662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3215b20-cc1c-4bfb-b4a7-40a472dcde8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:36.978898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714cc97-6f87-44a5-a179-d8974be30b3c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:37.091493 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3215b20-cc1c-4bfb-b4a7-40a472dcde8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:37.093182 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3215b20-cc1c-4bfb-b4a7-40a472dcde8f service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:37.093829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714cc97-6f87-44a5-a179-d8974be30b3c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:37.104914 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6674c6-949d-41f2-bad4-f62d28481c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:37.107014 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6674c6-949d-41f2-bad4-f62d28481c7d service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:37.108202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6674c6-949d-41f2-bad4-f62d28481c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:37.109269 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6674c6-949d-41f2-bad4-f62d28481c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:37.125664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 805/1633] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:36 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:37.129443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6674c6-949d-41f2-bad4-f62d28481c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:37.132367 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6674c6-949d-41f2-bad4-f62d28481c7d service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:37.156746 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 829/1634] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:36 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:37.360787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772e545-aae9-4d67-b48b-e776e72be48a None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:37.361305 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772e545-aae9-4d67-b48b-e776e72be48a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:37.361745 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772e545-aae9-4d67-b48b-e776e72be48a None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:37.363965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 806/1635] 10.222.0.23 () {54 vars in 912 bytes} [Thu Dec 9 01:08:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:08:37.373381 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194125c9-217f-417b-b62d-fca47afc87c3 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:37.373851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194125c9-217f-417b-b62d-fca47afc87c3 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:37.374277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194125c9-217f-417b-b62d-fca47afc87c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:37.413218 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-194125c9-217f-417b-b62d-fca47afc87c3 None None] MFA Rules not processed for user `53d32ba063bc4a719d4c2f67d88ec640`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:37.414596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-194125c9-217f-417b-b62d-fca47afc87c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:37.426766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772e545-aae9-4d67-b48b-e776e72be48a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:37.429404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 830/1636] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:08:37 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:37.440883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772e545-aae9-4d67-b48b-e776e72be48a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:37.446016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d9b05-130e-4866-88c9-0f6a6ae78970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:37.447152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d9b05-130e-4866-88c9-0f6a6ae78970 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:37.447940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d9b05-130e-4866-88c9-0f6a6ae78970 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:37.448324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d9b05-130e-4866-88c9-0f6a6ae78970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:37.528467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d9b05-130e-4866-88c9-0f6a6ae78970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:37.532430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d9b05-130e-4866-88c9-0f6a6ae78970 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:37.550230 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 807/1637] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:37 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:08:37.656105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194125c9-217f-417b-b62d-fca47afc87c3 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:37.673627 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194125c9-217f-417b-b62d-fca47afc87c3 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:37.684494 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f57de-1f8a-456e-b89b-8765a15743fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:37.687314 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f57de-1f8a-456e-b89b-8765a15743fe service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:37.688021 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f57de-1f8a-456e-b89b-8765a15743fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:37.689080 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f57de-1f8a-456e-b89b-8765a15743fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:37.721036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f57de-1f8a-456e-b89b-8765a15743fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:37.726320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f57de-1f8a-456e-b89b-8765a15743fe service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:37.738051 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d6d8f-d895-4f77-8b44-49b92395a027 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:37.738404 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d6d8f-d895-4f77-8b44-49b92395a027 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:37.738717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d6d8f-d895-4f77-8b44-49b92395a027 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:37.740799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 808/1638] 10.222.0.23 () {54 vars in 912 bytes} [Thu Dec 9 01:08:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 01:08:37.752427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a34d1-26ed-454d-a53b-5e1685744843 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:37.752737 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a34d1-26ed-454d-a53b-5e1685744843 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:37.753203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a34d1-26ed-454d-a53b-5e1685744843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:37.782084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 831/1639] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:37 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:37.804327 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-280a34d1-26ed-454d-a53b-5e1685744843 None None] MFA Rules not processed for user `53d32ba063bc4a719d4c2f67d88ec640`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:37.808480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-280a34d1-26ed-454d-a53b-5e1685744843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:37.863545 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 809/1640] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:08:37 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:37.947150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f57de-1f8a-456e-b89b-8765a15743fe service cinder] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:37.962205 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f57de-1f8a-456e-b89b-8765a15743fe service cinder] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:37.981601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27f768-92a8-4d6a-a968-49616eb4b365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:37.981601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27f768-92a8-4d6a-a968-49616eb4b365 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:37.981601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27f768-92a8-4d6a-a968-49616eb4b365 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:37.981601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27f768-92a8-4d6a-a968-49616eb4b365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:38.001377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27f768-92a8-4d6a-a968-49616eb4b365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:38.003088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27f768-92a8-4d6a-a968-49616eb4b365 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:38.027055 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 832/1641] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:37 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:38.185262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a34d1-26ed-454d-a53b-5e1685744843 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:38.272296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a34d1-26ed-454d-a53b-5e1685744843 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:38.281211 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fd1e2-0e82-4b20-992e-8ad6c9eda3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:38.282303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fd1e2-0e82-4b20-992e-8ad6c9eda3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:38.282725 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fd1e2-0e82-4b20-992e-8ad6c9eda3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:38.283635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fd1e2-0e82-4b20-992e-8ad6c9eda3a1 admin admin] PATH_INFO: `/v3/users/0f38c905a91d453a8f971a84cc523a5b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:38.286377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fd1e2-0e82-4b20-992e-8ad6c9eda3a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f38c905a91d453a8f971a84cc523a5b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:38.289175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fd1e2-0e82-4b20-992e-8ad6c9eda3a1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:38.388046 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-312fd1e2-0e82-4b20-992e-8ad6c9eda3a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f38c905a91d453a8f971a84cc523a5b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:38.407497 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-312fd1e2-0e82-4b20-992e-8ad6c9eda3a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f38c905a91d453a8f971a84cc523a5b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:38.409315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-312fd1e2-0e82-4b20-992e-8ad6c9eda3a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f38c905a91d453a8f971a84cc523a5b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:38.410626 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-312fd1e2-0e82-4b20-992e-8ad6c9eda3a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f38c905a91d453a8f971a84cc523a5b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:38.450102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-312fd1e2-0e82-4b20-992e-8ad6c9eda3a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f38c905a91d453a8f971a84cc523a5b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:38.482346 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 810/1642] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:08:38 2021] DELETE /identity/v3/users/0f38c905a91d453a8f971a84cc523a5b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:38.484251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72e839-622d-449e-96bc-5e1f90be655e None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:38.484546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72e839-622d-449e-96bc-5e1f90be655e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:38.484925 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72e839-622d-449e-96bc-5e1f90be655e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:38.517637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-0b72e839-622d-449e-96bc-5e1f90be655e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:38.519223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0b72e839-622d-449e-96bc-5e1f90be655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:38.571657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36df02-0d65-4693-8345-84b3a4095397 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:38.571948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36df02-0d65-4693-8345-84b3a4095397 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:38.572248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36df02-0d65-4693-8345-84b3a4095397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:38.650106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-9e36df02-0d65-4693-8345-84b3a4095397 None None] MFA Rules not processed for user `59d2b98f1809405ab307a035062400c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:38.651573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9e36df02-0d65-4693-8345-84b3a4095397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:38.712894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 833/1643] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:38.755791 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72e839-622d-449e-96bc-5e1f90be655e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:38.757258 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0b72e839-622d-449e-96bc-5e1f90be655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:38.819712 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 811/1644] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:38 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:38.822619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7325c-73ac-4481-85fc-fe31e9c71ec8 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:38.823210 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7325c-73ac-4481-85fc-fe31e9c71ec8 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:38.823924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7325c-73ac-4481-85fc-fe31e9c71ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:38.871173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-7bc7325c-73ac-4481-85fc-fe31e9c71ec8 None None] MFA Rules not processed for user `98b74ad2c40f4a7caf926c7954046137`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:38.873328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7bc7325c-73ac-4481-85fc-fe31e9c71ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:38.894201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72e839-622d-449e-96bc-5e1f90be655e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:38.898782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dc5dc-69b5-44fe-aa68-9b23a1246f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:38.899441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dc5dc-69b5-44fe-aa68-9b23a1246f85 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:38.899725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dc5dc-69b5-44fe-aa68-9b23a1246f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:38.900007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dc5dc-69b5-44fe-aa68-9b23a1246f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:38.920397 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dc5dc-69b5-44fe-aa68-9b23a1246f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:38.921960 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dc5dc-69b5-44fe-aa68-9b23a1246f85 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:38.942967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 834/1645] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:08:38.944641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55821a-0a0d-4112-98a7-cac462c32a5d None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:38.945110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55821a-0a0d-4112-98a7-cac462c32a5d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:38.945542 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55821a-0a0d-4112-98a7-cac462c32a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:38.989319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ef55821a-0a0d-4112-98a7-cac462c32a5d None None] MFA Rules not processed for user `59d2b98f1809405ab307a035062400c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:38.992557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ef55821a-0a0d-4112-98a7-cac462c32a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:39.030031 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 835/1646] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:38 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:39.030275 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 812/1647] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:38 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:39.042772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb51b5-d377-4a6f-9084-e759f6a6c69f None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:39.043260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb51b5-d377-4a6f-9084-e759f6a6c69f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:39.043548 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb51b5-d377-4a6f-9084-e759f6a6c69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:39.055580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7325c-73ac-4481-85fc-fe31e9c71ec8 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:39.057012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7bc7325c-73ac-4481-85fc-fe31e9c71ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:39.076011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-3cbb51b5-d377-4a6f-9084-e759f6a6c69f None None] MFA Rules not processed for user `98b74ad2c40f4a7caf926c7954046137`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:39.079476 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-3cbb51b5-d377-4a6f-9084-e759f6a6c69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:39.104586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 836/1648] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:39 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:39.155783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb51b5-d377-4a6f-9084-e759f6a6c69f None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:39.157164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-3cbb51b5-d377-4a6f-9084-e759f6a6c69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:39.273574 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb51b5-d377-4a6f-9084-e759f6a6c69f None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:39.291454 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242d03-cc14-4f9f-8713-ed9b8d11a7dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:39.292276 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242d03-cc14-4f9f-8713-ed9b8d11a7dd service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:39.293245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242d03-cc14-4f9f-8713-ed9b8d11a7dd service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:39.293526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242d03-cc14-4f9f-8713-ed9b8d11a7dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:39.315803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7325c-73ac-4481-85fc-fe31e9c71ec8 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:39.318695 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3242d03-cc14-4f9f-8713-ed9b8d11a7dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:39.320414 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3242d03-cc14-4f9f-8713-ed9b8d11a7dd service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:39.337292 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 837/1649] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:39 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:08:39.341303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6fec-5ebb-4e27-926a-7b668acb207d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:39.342539 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6fec-5ebb-4e27-926a-7b668acb207d service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:39.343174 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6fec-5ebb-4e27-926a-7b668acb207d service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:39.343470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6fec-5ebb-4e27-926a-7b668acb207d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:39.368654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f6fec-5ebb-4e27-926a-7b668acb207d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:39.373997 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f6fec-5ebb-4e27-926a-7b668acb207d service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:39.408897 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 813/1650] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:39 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:40.172378 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242d03-cc14-4f9f-8713-ed9b8d11a7dd service nova] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:40.173802 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a3242d03-cc14-4f9f-8713-ed9b8d11a7dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:40.189217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242d03-cc14-4f9f-8713-ed9b8d11a7dd service nova] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:40.194443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3387a-3946-48f2-91aa-2de4c2b98ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:40.195589 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3387a-3946-48f2-91aa-2de4c2b98ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.196015 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3387a-3946-48f2-91aa-2de4c2b98ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.196472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3387a-3946-48f2-91aa-2de4c2b98ea9 admin admin] PATH_INFO: `/v3/projects/7c550961fe9c4d39a948a838a3c7f6a9` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.198138 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3387a-3946-48f2-91aa-2de4c2b98ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c550961fe9c4d39a948a838a3c7f6a9)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:40.200460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3387a-3946-48f2-91aa-2de4c2b98ea9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:40.232958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f69db0-965e-4e8c-b727-a36c4366e69b None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.233584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f69db0-965e-4e8c-b727-a36c4366e69b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.234128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f69db0-965e-4e8c-b727-a36c4366e69b None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.237733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 814/1651] 10.222.0.23 () {54 vars in 912 bytes} [Thu Dec 9 01:08:40 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 09 01:08:40.250269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60ff3-981a-4e85-a866-2f25579d8762 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.251580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60ff3-981a-4e85-a866-2f25579d8762 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.252553 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60ff3-981a-4e85-a866-2f25579d8762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.303835 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-81d3387a-3946-48f2-91aa-2de4c2b98ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c550961fe9c4d39a948a838a3c7f6a9', 'request_id': 'req-81d3387a-3946-48f2-91aa-2de4c2b98ea9'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:40.312156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-81d3387a-3946-48f2-91aa-2de4c2b98ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c550961fe9c4d39a948a838a3c7f6a9', 'request_id': 'req-81d3387a-3946-48f2-91aa-2de4c2b98ea9'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:40.324721 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-81d3387a-3946-48f2-91aa-2de4c2b98ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c550961fe9c4d39a948a838a3c7f6a9', 'request_id': 'req-81d3387a-3946-48f2-91aa-2de4c2b98ea9'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:40.346180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c4e60ff3-981a-4e85-a866-2f25579d8762 None None] MFA Rules not processed for user `0ab73b6f3a1949359549f91e1b708600`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:40.348289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c4e60ff3-981a-4e85-a866-2f25579d8762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:40.350903 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-81d3387a-3946-48f2-91aa-2de4c2b98ea9 admin admin] The token cache is being invalidate because project 7c550961fe9c4d39a948a838a3c7f6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:08:40.351289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-81d3387a-3946-48f2-91aa-2de4c2b98ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:40.352827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-81d3387a-3946-48f2-91aa-2de4c2b98ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:40.361313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 838/1652] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:08:40 2021] DELETE /identity/v3/projects/7c550961fe9c4d39a948a838a3c7f6a9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:40.366145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781384af-bb2e-4a93-9a84-f549e31cef8d None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.366461 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781384af-bb2e-4a93-9a84-f549e31cef8d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.366938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781384af-bb2e-4a93-9a84-f549e31cef8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.399237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-781384af-bb2e-4a93-9a84-f549e31cef8d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:40.401804 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-781384af-bb2e-4a93-9a84-f549e31cef8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:40.446310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 815/1653] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:08:40 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:40.448123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2becdfd-bdc1-4097-b7b2-3b5d557e25f6 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.448636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2becdfd-bdc1-4097-b7b2-3b5d557e25f6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.449270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2becdfd-bdc1-4097-b7b2-3b5d557e25f6 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.451853 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 816/1654] 10.222.0.23 () {54 vars in 912 bytes} [Thu Dec 9 01:08:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:08:40.457770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebdc67-bf5f-4e5e-9eaf-79517201b23a None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.458313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebdc67-bf5f-4e5e-9eaf-79517201b23a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.459653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebdc67-bf5f-4e5e-9eaf-79517201b23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.482947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e4ebdc67-bf5f-4e5e-9eaf-79517201b23a None None] MFA Rules not processed for user `0ab73b6f3a1949359549f91e1b708600`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:40.485121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e4ebdc67-bf5f-4e5e-9eaf-79517201b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:40.495815 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 817/1655] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:08:40 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:08:40.510139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 839/1656] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:40.519353 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781384af-bb2e-4a93-9a84-f549e31cef8d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:40.519481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed89847-57f9-498b-936c-fb870a32482b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.519638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed89847-57f9-498b-936c-fb870a32482b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.520972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-781384af-bb2e-4a93-9a84-f549e31cef8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:40.521466 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed89847-57f9-498b-936c-fb870a32482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.546584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781384af-bb2e-4a93-9a84-f549e31cef8d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:40.547028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-2ed89847-57f9-498b-936c-fb870a32482b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:40.550231 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2ed89847-57f9-498b-936c-fb870a32482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:40.568970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ec430-91ab-41e2-bcfd-235963c8fd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:40.569731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ec430-91ab-41e2-bcfd-235963c8fd9f service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.570091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ec430-91ab-41e2-bcfd-235963c8fd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.570541 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ec430-91ab-41e2-bcfd-235963c8fd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.577078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 818/1657] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:40.577078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed89847-57f9-498b-936c-fb870a32482b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:40.663492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ec430-91ab-41e2-bcfd-235963c8fd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:40.663492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ec430-91ab-41e2-bcfd-235963c8fd9f service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:40.668012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed89847-57f9-498b-936c-fb870a32482b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:40.668012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc0fa9-ee21-4949-8617-517040cff8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:40.668012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc0fa9-ee21-4949-8617-517040cff8ac service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.668012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc0fa9-ee21-4949-8617-517040cff8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.668454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc0fa9-ee21-4949-8617-517040cff8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.669093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 840/1658] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:40.669093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ec430-91ab-41e2-bcfd-235963c8fd9f service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:40.669261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc0fa9-ee21-4949-8617-517040cff8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:40.669261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc0fa9-ee21-4949-8617-517040cff8ac service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:40.669454 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ec430-91ab-41e2-bcfd-235963c8fd9f service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:40.669587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 819/1659] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:40.669727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca022a-6ffc-4497-83e6-fd663d616abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:40.669727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca022a-6ffc-4497-83e6-fd663d616abf admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.669727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca022a-6ffc-4497-83e6-fd663d616abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.669727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca022a-6ffc-4497-83e6-fd663d616abf admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.670272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca022a-6ffc-4497-83e6-fd663d616abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:08:40.670272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca022a-6ffc-4497-83e6-fd663d616abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:40.670272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca022a-6ffc-4497-83e6-fd663d616abf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:40.678915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 841/1660] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:08:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:08:40.683016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc0fa9-ee21-4949-8617-517040cff8ac service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:40.701596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc0fa9-ee21-4949-8617-517040cff8ac service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:40.709161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022467a-1de0-4e5e-a493-9126afe7f451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:40.709947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022467a-1de0-4e5e-a493-9126afe7f451 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.710331 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022467a-1de0-4e5e-a493-9126afe7f451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.710761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022467a-1de0-4e5e-a493-9126afe7f451 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.711573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022467a-1de0-4e5e-a493-9126afe7f451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:40.713649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022467a-1de0-4e5e-a493-9126afe7f451 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:40.767581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 820/1661] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:40 2021] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:08:40.772096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca022a-6ffc-4497-83e6-fd663d616abf admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:40.789329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca022a-6ffc-4497-83e6-fd663d616abf admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:40.864954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c751ad-d5db-464d-a227-7ec247f268ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:40.865711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c751ad-d5db-464d-a227-7ec247f268ce admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.866064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c751ad-d5db-464d-a227-7ec247f268ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.866429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c751ad-d5db-464d-a227-7ec247f268ce admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.867203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c751ad-d5db-464d-a227-7ec247f268ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:40.869715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c751ad-d5db-464d-a227-7ec247f268ce admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:40.901422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 842/1662] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:40 2021] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:40.902225 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022467a-1de0-4e5e-a493-9126afe7f451 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:40.914070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022467a-1de0-4e5e-a493-9126afe7f451 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:40.920436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad6f3a-2d29-4206-a74c-596fa37edf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:40.921253 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad6f3a-2d29-4206-a74c-596fa37edf2f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.921547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad6f3a-2d29-4206-a74c-596fa37edf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.921826 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad6f3a-2d29-4206-a74c-596fa37edf2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.922764 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad6f3a-2d29-4206-a74c-596fa37edf2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:40.924380 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad6f3a-2d29-4206-a74c-596fa37edf2f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:40.942640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 821/1663] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:40 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:40.947908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c751ad-d5db-464d-a227-7ec247f268ce admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:40.961035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c751ad-d5db-464d-a227-7ec247f268ce admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:40.972272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd99c01-b636-4b5b-b61c-aa3baac90bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:40.973171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd99c01-b636-4b5b-b61c-aa3baac90bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:40.973547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd99c01-b636-4b5b-b61c-aa3baac90bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:40.973915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd99c01-b636-4b5b-b61c-aa3baac90bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:40.974753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd99c01-b636-4b5b-b61c-aa3baac90bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:40.977219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd99c01-b636-4b5b-b61c-aa3baac90bf2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:41.003027 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 843/1664] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:40 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:41.006520 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad6f3a-2d29-4206-a74c-596fa37edf2f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:41.021087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad6f3a-2d29-4206-a74c-596fa37edf2f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:41.027011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18785845-8b7b-40c1-a78a-05b6ed34e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:41.028813 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18785845-8b7b-40c1-a78a-05b6ed34e5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:41.029213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18785845-8b7b-40c1-a78a-05b6ed34e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:41.029716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18785845-8b7b-40c1-a78a-05b6ed34e5a7 admin admin] PATH_INFO: `/v3/projects/c33c40a00df94fed8765b9c56dd957c7/users/081ffcea0945461baff72c782805c15a/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:41.060409 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18785845-8b7b-40c1-a78a-05b6ed34e5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33c40a00df94fed8765b9c56dd957c7, user_id=081ffcea0945461baff72c782805c15a, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:41.063101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18785845-8b7b-40c1-a78a-05b6ed34e5a7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:41.096214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 822/1665] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:41 2021] PUT /identity/v3/projects/c33c40a00df94fed8765b9c56dd957c7/users/081ffcea0945461baff72c782805c15a/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:08:41.143720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714fb44-9c51-447e-885d-27b02a344f7d None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:41.144229 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714fb44-9c51-447e-885d-27b02a344f7d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:41.147455 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714fb44-9c51-447e-885d-27b02a344f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:41.188156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-0714fb44-9c51-447e-885d-27b02a344f7d None None] MFA Rules not processed for user `081ffcea0945461baff72c782805c15a`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:41.190672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0714fb44-9c51-447e-885d-27b02a344f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:41.281363 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 844/1666] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:41 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:41.282320 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18785845-8b7b-40c1-a78a-05b6ed34e5a7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:41.376378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18785845-8b7b-40c1-a78a-05b6ed34e5a7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:41.383585 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080d74c-3720-4e86-9619-634067b5be9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:41.384340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080d74c-3720-4e86-9619-634067b5be9b admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:41.384671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080d74c-3720-4e86-9619-634067b5be9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:41.385076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080d74c-3720-4e86-9619-634067b5be9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:41.386111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080d74c-3720-4e86-9619-634067b5be9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:41.389155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080d74c-3720-4e86-9619-634067b5be9b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:41.437382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714fb44-9c51-447e-885d-27b02a344f7d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:41.447739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 823/1667] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:41 2021] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:08:41.448889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714fb44-9c51-447e-885d-27b02a344f7d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:41.533166 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f90f2-29e6-4e08-91ce-32a7924cf032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:41.533848 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f90f2-29e6-4e08-91ce-32a7924cf032 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:41.534132 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f90f2-29e6-4e08-91ce-32a7924cf032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:41.534946 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f90f2-29e6-4e08-91ce-32a7924cf032 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:41.535834 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f90f2-29e6-4e08-91ce-32a7924cf032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:41.538121 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f90f2-29e6-4e08-91ce-32a7924cf032 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:41.589439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 845/1668] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:41 2021] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:08:41.593604 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080d74c-3720-4e86-9619-634067b5be9b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:41.625522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080d74c-3720-4e86-9619-634067b5be9b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:41.639392 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d8f59-2076-493b-803e-ea873d7e313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:41.640087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d8f59-2076-493b-803e-ea873d7e313e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:41.640372 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d8f59-2076-493b-803e-ea873d7e313e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:41.640661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d8f59-2076-493b-803e-ea873d7e313e admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:41.641403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d8f59-2076-493b-803e-ea873d7e313e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:41.643094 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d8f59-2076-493b-803e-ea873d7e313e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:41.686213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 824/1669] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:41 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:41.687481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f90f2-29e6-4e08-91ce-32a7924cf032 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:41.701818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f90f2-29e6-4e08-91ce-32a7924cf032 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:41.716828 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f53051-ed3e-44f0-ada1-159fab00d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:41.717847 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f53051-ed3e-44f0-ada1-159fab00d28f admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:41.718197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f53051-ed3e-44f0-ada1-159fab00d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:41.718589 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f53051-ed3e-44f0-ada1-159fab00d28f admin admin] PATH_INFO: `/v3/projects/d5a222d1381c45bc903ead1763652134/users/ec16270d497848bc8cea911decd618d3/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:41.751566 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f53051-ed3e-44f0-ada1-159fab00d28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a222d1381c45bc903ead1763652134, user_id=ec16270d497848bc8cea911decd618d3, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:41.754263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f53051-ed3e-44f0-ada1-159fab00d28f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:41.798622 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 846/1670] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:41 2021] PUT /identity/v3/projects/d5a222d1381c45bc903ead1763652134/users/ec16270d497848bc8cea911decd618d3/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:41.800004 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d8f59-2076-493b-803e-ea873d7e313e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:41.812471 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d8f59-2076-493b-803e-ea873d7e313e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:41.887479 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f53051-ed3e-44f0-ada1-159fab00d28f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:41.889497 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b9f53051-ed3e-44f0-ada1-159fab00d28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:42.029333 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c7b0d-a669-4d69-a2a2-d90ad386184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:42.031051 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c7b0d-a669-4d69-a2a2-d90ad386184a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:42.031516 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c7b0d-a669-4d69-a2a2-d90ad386184a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:42.031948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c7b0d-a669-4d69-a2a2-d90ad386184a admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:42.033506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c7b0d-a669-4d69-a2a2-d90ad386184a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:42.037398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c7b0d-a669-4d69-a2a2-d90ad386184a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:42.069939 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 825/1671] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:41 2021] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:42.072861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c7b0d-a669-4d69-a2a2-d90ad386184a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:42.098018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c7b0d-a669-4d69-a2a2-d90ad386184a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:42.132853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f53051-ed3e-44f0-ada1-159fab00d28f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:42.147143 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f38c8-1845-430b-8878-4052717f1fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:42.149517 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f38c8-1845-430b-8878-4052717f1fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:42.152981 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f38c8-1845-430b-8878-4052717f1fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:42.153348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f38c8-1845-430b-8878-4052717f1fb5 admin admin] PATH_INFO: `/v3/projects/d5a222d1381c45bc903ead1763652134/users/ec16270d497848bc8cea911decd618d3/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:42.162750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f38c8-1845-430b-8878-4052717f1fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a222d1381c45bc903ead1763652134, user_id=ec16270d497848bc8cea911decd618d3, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:42.169816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f3baa-0515-4560-92cd-ee5c64aa335f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cebb33ff7c4e40a06b3c7f1a40823d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:42.170519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f3baa-0515-4560-92cd-ee5c64aa335f service placement] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:42.172769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f3baa-0515-4560-92cd-ee5c64aa335f service placement] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:42.172961 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f3baa-0515-4560-92cd-ee5c64aa335f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:42.178664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a65f3baa-0515-4560-92cd-ee5c64aa335f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:42.183797 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f38c8-1845-430b-8878-4052717f1fb5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:42.233542 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f3baa-0515-4560-92cd-ee5c64aa335f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:42.239359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f3baa-0515-4560-92cd-ee5c64aa335f service placement] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:42.247861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 826/1672] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:42 2021] PUT /identity/v3/projects/d5a222d1381c45bc903ead1763652134/users/ec16270d497848bc8cea911decd618d3/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:42.255947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383a41e-f073-4f76-b7aa-df7afb6e7fe6 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:42.256938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383a41e-f073-4f76-b7aa-df7afb6e7fe6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:42.257329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383a41e-f073-4f76-b7aa-df7afb6e7fe6 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:42.268063 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 827/1673] 10.222.0.23 () {54 vars in 960 bytes} [Thu Dec 9 01:08:42 2021] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:08:42.276235 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127457b-9feb-4bd3-b154-3c178ccc57ba None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:42.277460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127457b-9feb-4bd3-b154-3c178ccc57ba None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:42.278163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127457b-9feb-4bd3-b154-3c178ccc57ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:42.285748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 847/1674] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:41 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:08:42.289047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fffafe-2d9d-4243-a25e-09afe0d7cafb None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:42.289341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fffafe-2d9d-4243-a25e-09afe0d7cafb None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:42.289623 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fffafe-2d9d-4243-a25e-09afe0d7cafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:42.347947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-b4fffafe-2d9d-4243-a25e-09afe0d7cafb None None] MFA Rules not processed for user `a2cebb33ff7c4e40a06b3c7f1a40823d`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:42.349221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b4fffafe-2d9d-4243-a25e-09afe0d7cafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:42.421381 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-9127457b-9feb-4bd3-b154-3c178ccc57ba None None] MFA Rules not processed for user `ec16270d497848bc8cea911decd618d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:42.430026 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9127457b-9feb-4bd3-b154-3c178ccc57ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:42.638317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 848/1675] 10.222.0.23 () {58 vars in 1057 bytes} [Thu Dec 9 01:08:42 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:42.648654 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fffafe-2d9d-4243-a25e-09afe0d7cafb None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:42.676606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fffafe-2d9d-4243-a25e-09afe0d7cafb None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:42.682062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 828/1676] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:42 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:42.696827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05106f93-41a5-4617-8598-f74f77d84fa1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cebb33ff7c4e40a06b3c7f1a40823d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:42.697498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05106f93-41a5-4617-8598-f74f77d84fa1 service placement] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:42.697778 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05106f93-41a5-4617-8598-f74f77d84fa1 service placement] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:42.698051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05106f93-41a5-4617-8598-f74f77d84fa1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:42.706148 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127457b-9feb-4bd3-b154-3c178ccc57ba None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:42.707442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9127457b-9feb-4bd3-b154-3c178ccc57ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:42.738908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05106f93-41a5-4617-8598-f74f77d84fa1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:42.740671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05106f93-41a5-4617-8598-f74f77d84fa1 service placement] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:42.771077 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 849/1677] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:08:42.866682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127457b-9feb-4bd3-b154-3c178ccc57ba None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:42.876386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc0c56-684e-4c89-be4a-31ae4122de19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:42.877640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc0c56-684e-4c89-be4a-31ae4122de19 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:42.877934 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc0c56-684e-4c89-be4a-31ae4122de19 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:42.878223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc0c56-684e-4c89-be4a-31ae4122de19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:42.910097 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc0c56-684e-4c89-be4a-31ae4122de19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:42.911629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc0c56-684e-4c89-be4a-31ae4122de19 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:42.930453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 829/1678] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:42 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:08:43.295749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05106f93-41a5-4617-8598-f74f77d84fa1 service placement] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:43.408482 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05106f93-41a5-4617-8598-f74f77d84fa1 service placement] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:43.430491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:43.431464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:43.431811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:43.432159 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] PATH_INFO: `/v3/users/081ffcea0945461baff72c782805c15a` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:43.439067 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=081ffcea0945461baff72c782805c15a)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:43.440281 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: WARNING py.warnings [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:08:43.440281 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: warnings.warn(msg) Dec 09 01:08:43.440281 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: Dec 09 01:08:43.441729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:43.639027 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081ffcea0945461baff72c782805c15a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:43.640952 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081ffcea0945461baff72c782805c15a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:43.675016 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081ffcea0945461baff72c782805c15a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:43.676348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081ffcea0945461baff72c782805c15a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:43.730262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081ffcea0945461baff72c782805c15a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:43.753852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 850/1679] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:08:43 2021] DELETE /identity/v3/users/081ffcea0945461baff72c782805c15a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:43.758258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7dc4-4a87-487f-83f8-aa7beddf42ab None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:43.758856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7dc4-4a87-487f-83f8-aa7beddf42ab None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:43.759063 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7dc4-4a87-487f-83f8-aa7beddf42ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:43.801168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-882b7dc4-4a87-487f-83f8-aa7beddf42ab None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:43.804967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-882b7dc4-4a87-487f-83f8-aa7beddf42ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:43.989180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 830/1680] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:44.002708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:44.004891 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:44.151369 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd8b7c-d8f6-42d5-add0-00d5e710ef9e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:44.157321 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6485c-6872-45b6-b3f4-f215ca5c820a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:44.158134 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6485c-6872-45b6-b3f4-f215ca5c820a service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:44.158585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6485c-6872-45b6-b3f4-f215ca5c820a service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:44.158966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6485c-6872-45b6-b3f4-f215ca5c820a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:44.179883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6485c-6872-45b6-b3f4-f215ca5c820a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:44.183471 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6485c-6872-45b6-b3f4-f215ca5c820a service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:44.211106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 851/1681] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:45.398418 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed5ead-873d-403a-b73a-37248b543e9b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:45.399889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed5ead-873d-403a-b73a-37248b543e9b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:45.400321 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed5ead-873d-403a-b73a-37248b543e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:45.420212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6485c-6872-45b6-b3f4-f215ca5c820a service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:45.422880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1dd6485c-6872-45b6-b3f4-f215ca5c820a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:45.441731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6485c-6872-45b6-b3f4-f215ca5c820a service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:45.466769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:45.466769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:45.466769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:45.466769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] PATH_INFO: `/v3/projects/c33c40a00df94fed8765b9c56dd957c7` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:45.467419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33c40a00df94fed8765b9c56dd957c7)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:45.467419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:45.477576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-31ed5ead-873d-403a-b73a-37248b543e9b None None] MFA Rules not processed for user `d5ff623eda804e5980eee894d43cdc2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:45.479083 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-31ed5ead-873d-403a-b73a-37248b543e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:45.578230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33c40a00df94fed8765b9c56dd957c7', 'request_id': 'req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:45.583542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 831/1682] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:45 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:45.589964 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33c40a00df94fed8765b9c56dd957c7', 'request_id': 'req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:45.605217 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073aff-1025-4adb-aaf5-5da13aec8318 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:45.605846 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073aff-1025-4adb-aaf5-5da13aec8318 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:45.606423 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073aff-1025-4adb-aaf5-5da13aec8318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:45.620176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33c40a00df94fed8765b9c56dd957c7', 'request_id': 'req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:45.635472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] The token cache is being invalidate because project c33c40a00df94fed8765b9c56dd957c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:08:45.635653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:45.638830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:45.649049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 852/1683] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:08:45 2021] DELETE /identity/v3/projects/c33c40a00df94fed8765b9c56dd957c7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:45.650620 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:45.652383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:45.660881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-46073aff-1025-4adb-aaf5-5da13aec8318 None None] MFA Rules not processed for user `d5ff623eda804e5980eee894d43cdc2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:45.661933 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-46073aff-1025-4adb-aaf5-5da13aec8318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:45.801324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 832/1684] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:45 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:45.812608 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46073aff-1025-4adb-aaf5-5da13aec8318 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:45.816331 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-46073aff-1025-4adb-aaf5-5da13aec8318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:45.816472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24248d05-f6f0-4c5c-a096-cd53b36fd3b4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:45.844159 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:45.844963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:45.845244 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:45.845518 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] PATH_INFO: `/v3/users/ec16270d497848bc8cea911decd618d3` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:45.852132 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec16270d497848bc8cea911decd618d3)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:45.854135 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:45.969226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec16270d497848bc8cea911decd618d3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:45.969994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec16270d497848bc8cea911decd618d3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:45.979193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec16270d497848bc8cea911decd618d3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:45.980549 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec16270d497848bc8cea911decd618d3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:45.990481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46073aff-1025-4adb-aaf5-5da13aec8318 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:46.006630 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062539a-3cf0-4c62-b14b-380c5c639707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:46.007358 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062539a-3cf0-4c62-b14b-380c5c639707 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:46.007647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062539a-3cf0-4c62-b14b-380c5c639707 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:46.007928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062539a-3cf0-4c62-b14b-380c5c639707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:46.014880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec16270d497848bc8cea911decd618d3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:46.015193 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4062539a-3cf0-4c62-b14b-380c5c639707 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:46.051429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 853/1685] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:08:45 2021] DELETE /identity/v3/users/ec16270d497848bc8cea911decd618d3 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:46.052441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062539a-3cf0-4c62-b14b-380c5c639707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:46.056011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062539a-3cf0-4c62-b14b-380c5c639707 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:46.085316 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 833/1686] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:45 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:46.808040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:46.810599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:46.994621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5af65-74a4-48f2-97bc-0c0949d87cb9 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:46.995488 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5af65-74a4-48f2-97bc-0c0949d87cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:46.995938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5af65-74a4-48f2-97bc-0c0949d87cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:47.094683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-3cf5af65-74a4-48f2-97bc-0c0949d87cb9 None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:47.096361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-3cf5af65-74a4-48f2-97bc-0c0949d87cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:47.156981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ec330-f90b-4558-864f-c0660613abaf admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:47.181556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:47.182497 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:47.182787 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:47.183071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] PATH_INFO: `/v3/users/fbf2cc7ed59f434e864560cd2ca8e3fe` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:47.185907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf2cc7ed59f434e864560cd2ca8e3fe)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:47.187913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:47.309331 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf2cc7ed59f434e864560cd2ca8e3fe'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:47.310187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf2cc7ed59f434e864560cd2ca8e3fe'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:47.328202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf2cc7ed59f434e864560cd2ca8e3fe'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:47.328944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf2cc7ed59f434e864560cd2ca8e3fe'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:47.345567 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 834/1687] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:08:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Dec 09 01:08:47.380364 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf2cc7ed59f434e864560cd2ca8e3fe'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:47.407615 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 854/1688] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:08:46 2021] DELETE /identity/v3/users/fbf2cc7ed59f434e864560cd2ca8e3fe => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:47.413795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84e0f5-4c8f-4ff3-82df-a71c7d94f8cd None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:47.414841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84e0f5-4c8f-4ff3-82df-a71c7d94f8cd None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:47.415865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84e0f5-4c8f-4ff3-82df-a71c7d94f8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:47.485623 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-1d84e0f5-4c8f-4ff3-82df-a71c7d94f8cd None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:47.491195 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-1d84e0f5-4c8f-4ff3-82df-a71c7d94f8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:47.646206 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 835/1689] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:47.650233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:47.651769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:47.691832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84e0f5-4c8f-4ff3-82df-a71c7d94f8cd None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:47.693244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-1d84e0f5-4c8f-4ff3-82df-a71c7d94f8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:47.890440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84e0f5-4c8f-4ff3-82df-a71c7d94f8cd None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:47.890440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ddf75-a8b8-4e1a-8df2-5db1e76f5fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:47.890440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ddf75-a8b8-4e1a-8df2-5db1e76f5fde service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:47.890440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ddf75-a8b8-4e1a-8df2-5db1e76f5fde service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:47.890983 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ddf75-a8b8-4e1a-8df2-5db1e76f5fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:47.905214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ddf75-a8b8-4e1a-8df2-5db1e76f5fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:47.907995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ddf75-a8b8-4e1a-8df2-5db1e76f5fde service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:47.954254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 836/1690] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:47.955414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ddf75-a8b8-4e1a-8df2-5db1e76f5fde service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:47.958001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-593ddf75-a8b8-4e1a-8df2-5db1e76f5fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:47.967124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444ce2a-fffc-4fbd-8af7-bb94506cde5f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:47.984751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33689bb6-d3ff-46ba-8aac-614183bd6601 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:47.985784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33689bb6-d3ff-46ba-8aac-614183bd6601 service swift] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:47.986175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33689bb6-d3ff-46ba-8aac-614183bd6601 service swift] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:47.986715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33689bb6-d3ff-46ba-8aac-614183bd6601 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:47.990255 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ddf75-a8b8-4e1a-8df2-5db1e76f5fde service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:48.015825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:48.016706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:48.016984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:48.017259 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] PATH_INFO: `/v3/projects/d5a222d1381c45bc903ead1763652134` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:48.023647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a222d1381c45bc903ead1763652134)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:48.030778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: WARNING py.warnings [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:08:48.030778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: warnings.warn(msg) Dec 09 01:08:48.030778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: Dec 09 01:08:48.032002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:48.130975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33689bb6-d3ff-46ba-8aac-614183bd6601 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:48.136685 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33689bb6-d3ff-46ba-8aac-614183bd6601 service swift] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:48.170574 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 855/1691] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:08:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 01:08:48.171881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a222d1381c45bc903ead1763652134', 'request_id': 'req-b2e7ec82-a0b2-4496-87f2-10159f48227a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:48.179673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a222d1381c45bc903ead1763652134', 'request_id': 'req-b2e7ec82-a0b2-4496-87f2-10159f48227a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:48.221931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a222d1381c45bc903ead1763652134', 'request_id': 'req-b2e7ec82-a0b2-4496-87f2-10159f48227a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:48.257455 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] The token cache is being invalidate because project d5a222d1381c45bc903ead1763652134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:08:48.257763 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:48.270460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b2e7ec82-a0b2-4496-87f2-10159f48227a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:48.278671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 837/1692] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:08:47 2021] DELETE /identity/v3/projects/d5a222d1381c45bc903ead1763652134 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:48.285351 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4678b7-7ff8-4ec3-a175-893b22bf88a5 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:48.285644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4678b7-7ff8-4ec3-a175-893b22bf88a5 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:48.285933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4678b7-7ff8-4ec3-a175-893b22bf88a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:48.339761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-5e4678b7-7ff8-4ec3-a175-893b22bf88a5 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:48.342663 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5e4678b7-7ff8-4ec3-a175-893b22bf88a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:48.599616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 856/1693] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:48.607513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1919697-e2ba-4a53-8ccc-93cc6c882148 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:48.609625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1919697-e2ba-4a53-8ccc-93cc6c882148 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:48.610064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1919697-e2ba-4a53-8ccc-93cc6c882148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:48.663569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b1919697-e2ba-4a53-8ccc-93cc6c882148 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:48.672078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b1919697-e2ba-4a53-8ccc-93cc6c882148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:48.704430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 838/1694] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:08:48.708570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4678b7-7ff8-4ec3-a175-893b22bf88a5 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:48.723801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4678b7-7ff8-4ec3-a175-893b22bf88a5 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:48.747094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fd585-0f45-44e9-8417-1c0f13338d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:48.754330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fd585-0f45-44e9-8417-1c0f13338d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:48.756171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fd585-0f45-44e9-8417-1c0f13338d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:48.756710 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fd585-0f45-44e9-8417-1c0f13338d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:48.758358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fd585-0f45-44e9-8417-1c0f13338d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:08:48.760911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fd585-0f45-44e9-8417-1c0f13338d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:48.768193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fd585-0f45-44e9-8417-1c0f13338d58 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:48.813400 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 857/1695] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:08:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 01:08:48.816390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1919697-e2ba-4a53-8ccc-93cc6c882148 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:48.828082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1919697-e2ba-4a53-8ccc-93cc6c882148 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:48.868461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20516f-071a-4618-a111-33cd925d0084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:48.881187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20516f-071a-4618-a111-33cd925d0084 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:48.881573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20516f-071a-4618-a111-33cd925d0084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:48.881860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20516f-071a-4618-a111-33cd925d0084 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:48.882661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20516f-071a-4618-a111-33cd925d0084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:48.884623 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20516f-071a-4618-a111-33cd925d0084 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:49.000086 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fd585-0f45-44e9-8417-1c0f13338d58 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:49.011346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fd585-0f45-44e9-8417-1c0f13338d58 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:49.014669 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 839/1696] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:48 2021] POST /identity/v3/projects => generated 357 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:49.017233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b9a5-e5ee-4cc6-a81e-bffa8d40de28 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:49.017854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b9a5-e5ee-4cc6-a81e-bffa8d40de28 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:49.018169 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b9a5-e5ee-4cc6-a81e-bffa8d40de28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:49.142503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-56a1b9a5-e5ee-4cc6-a81e-bffa8d40de28 None None] MFA Rules not processed for user `d5ff623eda804e5980eee894d43cdc2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:49.146131 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-56a1b9a5-e5ee-4cc6-a81e-bffa8d40de28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:49.287668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df131eff-f3a0-4439-bd82-2b848c2800e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:49.288356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df131eff-f3a0-4439-bd82-2b848c2800e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:49.288641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df131eff-f3a0-4439-bd82-2b848c2800e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:49.288933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df131eff-f3a0-4439-bd82-2b848c2800e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:49.289634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df131eff-f3a0-4439-bd82-2b848c2800e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:49.299911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df131eff-f3a0-4439-bd82-2b848c2800e2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:49.376689 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 858/1697] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:48 2021] POST /identity/v3/users => generated 279 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:08:49.378074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 840/1698] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:49 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:49.382214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df131eff-f3a0-4439-bd82-2b848c2800e2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:49.407799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df131eff-f3a0-4439-bd82-2b848c2800e2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:49.424683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc6b00-eac3-4208-bed6-f950b6026aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:49.426894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc6b00-eac3-4208-bed6-f950b6026aee admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:49.427337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc6b00-eac3-4208-bed6-f950b6026aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:49.427769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc6b00-eac3-4208-bed6-f950b6026aee admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:49.428676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc6b00-eac3-4208-bed6-f950b6026aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:49.432161 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc6b00-eac3-4208-bed6-f950b6026aee admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:49.459442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 859/1699] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:49 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:49.463573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1b9a5-e5ee-4cc6-a81e-bffa8d40de28 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:49.480081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1b9a5-e5ee-4cc6-a81e-bffa8d40de28 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:49.520258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b13d9a-2ae9-4071-9667-222f599a7819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:49.521211 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b13d9a-2ae9-4071-9667-222f599a7819 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:49.521650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b13d9a-2ae9-4071-9667-222f599a7819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:49.522081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b13d9a-2ae9-4071-9667-222f599a7819 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:49.523013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b13d9a-2ae9-4071-9667-222f599a7819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:49.524787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b13d9a-2ae9-4071-9667-222f599a7819 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:49.551141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 841/1700] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:49 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:49.555195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc6b00-eac3-4208-bed6-f950b6026aee admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:49.565587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc6b00-eac3-4208-bed6-f950b6026aee admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:49.586982 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6a172-2af4-4181-95b8-fe85df2ebd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:49.587924 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6a172-2af4-4181-95b8-fe85df2ebd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:49.588183 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6a172-2af4-4181-95b8-fe85df2ebd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:49.588457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6a172-2af4-4181-95b8-fe85df2ebd14 admin admin] PATH_INFO: `/v3/projects/fc932a5ac5c2441ebf01199b3ce4b317/users/9de6ccd3eb024742b3ca0b48f1ed244e/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:49.635079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6a172-2af4-4181-95b8-fe85df2ebd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc932a5ac5c2441ebf01199b3ce4b317, user_id=9de6ccd3eb024742b3ca0b48f1ed244e, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:49.637827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6a172-2af4-4181-95b8-fe85df2ebd14 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:49.687977 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 860/1701] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:49 2021] PUT /identity/v3/projects/fc932a5ac5c2441ebf01199b3ce4b317/users/9de6ccd3eb024742b3ca0b48f1ed244e/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:49.700133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5adf7d-8885-4bab-9960-4418c0c97698 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:49.700233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5adf7d-8885-4bab-9960-4418c0c97698 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:49.700433 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5adf7d-8885-4bab-9960-4418c0c97698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:49.756713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-aa5adf7d-8885-4bab-9960-4418c0c97698 None None] MFA Rules not processed for user `9de6ccd3eb024742b3ca0b48f1ed244e`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:49.757978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-aa5adf7d-8885-4bab-9960-4418c0c97698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:49.902318 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b025ef-d3a1-4d26-9273-30a84dd88dab None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:49.903239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b025ef-d3a1-4d26-9273-30a84dd88dab None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:49.903592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b025ef-d3a1-4d26-9273-30a84dd88dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:49.955082 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-c5b025ef-d3a1-4d26-9273-30a84dd88dab None None] MFA Rules not processed for user `0ab73b6f3a1949359549f91e1b708600`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:49.957045 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 842/1702] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:49 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:49.958256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c5b025ef-d3a1-4d26-9273-30a84dd88dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:49.963101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5adf7d-8885-4bab-9960-4418c0c97698 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:50.180925 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 861/1703] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Dec 9 01:08:49 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:50.195151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5adf7d-8885-4bab-9960-4418c0c97698 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:50.207975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43b544-2195-4ec8-b974-74d6b71a3c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:50.209047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43b544-2195-4ec8-b974-74d6b71a3c53 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:50.209541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43b544-2195-4ec8-b974-74d6b71a3c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:50.210020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43b544-2195-4ec8-b974-74d6b71a3c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:50.210965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43b544-2195-4ec8-b974-74d6b71a3c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:50.218351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43b544-2195-4ec8-b974-74d6b71a3c53 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:50.225782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b025ef-d3a1-4d26-9273-30a84dd88dab None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:50.227597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c5b025ef-d3a1-4d26-9273-30a84dd88dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:50.241908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b025ef-d3a1-4d26-9273-30a84dd88dab None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:50.269828 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441a6c5-ce8b-4a53-9042-801ceef9076b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:50.274377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441a6c5-ce8b-4a53-9042-801ceef9076b service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:50.277730 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441a6c5-ce8b-4a53-9042-801ceef9076b service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:50.278671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441a6c5-ce8b-4a53-9042-801ceef9076b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:50.311976 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441a6c5-ce8b-4a53-9042-801ceef9076b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:50.318582 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441a6c5-ce8b-4a53-9042-801ceef9076b service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:50.326343 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 843/1704] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:49 2021] POST /identity/v3/projects => generated 357 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:08:50.327990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43b544-2195-4ec8-b974-74d6b71a3c53 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:50.344768 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 862/1705] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:50 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:08:50.513024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441a6c5-ce8b-4a53-9042-801ceef9076b service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:50.514591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f441a6c5-ce8b-4a53-9042-801ceef9076b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:50.551876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441a6c5-ce8b-4a53-9042-801ceef9076b service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:50.570251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:50.571970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43b544-2195-4ec8-b974-74d6b71a3c53 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:50.575143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:50.576557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:50.577345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5 admin admin] PATH_INFO: `/v3/projects/d3f9e76c59a14a3eb6fbb1140ba4a22c` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:50.584490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f9e76c59a14a3eb6fbb1140ba4a22c)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:50.589366 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc766a5-8326-4396-89c4-bb9c3f560284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:50.592440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc766a5-8326-4396-89c4-bb9c3f560284 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:50.592895 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:50.594268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc766a5-8326-4396-89c4-bb9c3f560284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:50.594784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc766a5-8326-4396-89c4-bb9c3f560284 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:50.599651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc766a5-8326-4396-89c4-bb9c3f560284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:50.605282 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc766a5-8326-4396-89c4-bb9c3f560284 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:50.669695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 844/1706] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:50 2021] POST /identity/v3/users => generated 285 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:50.671121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc766a5-8326-4396-89c4-bb9c3f560284 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:50.696106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc766a5-8326-4396-89c4-bb9c3f560284 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:50.774261 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f9e76c59a14a3eb6fbb1140ba4a22c', 'request_id': 'req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:50.808142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f9e76c59a14a3eb6fbb1140ba4a22c', 'request_id': 'req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:50.834971 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3c65e-25df-4d52-8cb3-12cb5c87613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:50.836013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3c65e-25df-4d52-8cb3-12cb5c87613f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:50.836511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3c65e-25df-4d52-8cb3-12cb5c87613f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:50.837014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3c65e-25df-4d52-8cb3-12cb5c87613f admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:50.838536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3c65e-25df-4d52-8cb3-12cb5c87613f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:50.855401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f9e76c59a14a3eb6fbb1140ba4a22c', 'request_id': 'req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:50.858247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3c65e-25df-4d52-8cb3-12cb5c87613f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:50.892920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 845/1707] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:50 2021] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:50.897343 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3c65e-25df-4d52-8cb3-12cb5c87613f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:50.907447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5 admin admin] The token cache is being invalidate because project d3f9e76c59a14a3eb6fbb1140ba4a22c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:08:50.908057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:50.908872 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-131d4bc9-a0e0-48c4-b1c7-d9016f6f82f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:50.915391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 863/1708] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:08:50 2021] DELETE /identity/v3/projects/d3f9e76c59a14a3eb6fbb1140ba4a22c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:08:50.917158 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52be8a-bf83-4715-ab5f-eb1b6b2e46b8 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:50.919596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3c65e-25df-4d52-8cb3-12cb5c87613f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:50.926030 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52be8a-bf83-4715-ab5f-eb1b6b2e46b8 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:50.926961 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52be8a-bf83-4715-ab5f-eb1b6b2e46b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:50.945348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76192f-94bc-4150-9e9a-688f03ee5dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:50.946643 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76192f-94bc-4150-9e9a-688f03ee5dea admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:50.948180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76192f-94bc-4150-9e9a-688f03ee5dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:50.948597 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76192f-94bc-4150-9e9a-688f03ee5dea admin admin] PATH_INFO: `/v3/projects/1b88d9cb502d412f8ffa0ef9f4c70a94/users/6c5372ad0e0743efaa389d0a5d2b0075/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:50.992610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-0b52be8a-bf83-4715-ab5f-eb1b6b2e46b8 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:50.994220 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0b52be8a-bf83-4715-ab5f-eb1b6b2e46b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:51.004299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76192f-94bc-4150-9e9a-688f03ee5dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b88d9cb502d412f8ffa0ef9f4c70a94, user_id=6c5372ad0e0743efaa389d0a5d2b0075, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:51.009959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76192f-94bc-4150-9e9a-688f03ee5dea admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:51.036892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 864/1709] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:51.038391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176c9d-9125-4ac0-9e57-8d2bd4519e47 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:51.038898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176c9d-9125-4ac0-9e57-8d2bd4519e47 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:51.039177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176c9d-9125-4ac0-9e57-8d2bd4519e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:51.041864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 846/1710] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:50 2021] PUT /identity/v3/projects/1b88d9cb502d412f8ffa0ef9f4c70a94/users/6c5372ad0e0743efaa389d0a5d2b0075/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:08:51.048883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76192f-94bc-4150-9e9a-688f03ee5dea admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:51.053088 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0c76192f-94bc-4150-9e9a-688f03ee5dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:51.149991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-5c176c9d-9125-4ac0-9e57-8d2bd4519e47 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:51.152889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5c176c9d-9125-4ac0-9e57-8d2bd4519e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:51.194111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76192f-94bc-4150-9e9a-688f03ee5dea admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:51.211222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74b291-88cc-4fe3-9878-e3ace86022de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:51.211905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74b291-88cc-4fe3-9878-e3ace86022de admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:51.212292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74b291-88cc-4fe3-9878-e3ace86022de admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:51.212688 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74b291-88cc-4fe3-9878-e3ace86022de admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:51.213523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74b291-88cc-4fe3-9878-e3ace86022de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:51.215435 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74b291-88cc-4fe3-9878-e3ace86022de admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:51.241208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 847/1711] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:51 2021] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:51.245690 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74b291-88cc-4fe3-9878-e3ace86022de admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:51.265912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74b291-88cc-4fe3-9878-e3ace86022de admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:51.294461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b2df6-c84c-4ac7-b023-00e62b8f8d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:51.295468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b2df6-c84c-4ac7-b023-00e62b8f8d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:51.295817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b2df6-c84c-4ac7-b023-00e62b8f8d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:51.296171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b2df6-c84c-4ac7-b023-00e62b8f8d17 admin admin] PATH_INFO: `/v3/projects/1b88d9cb502d412f8ffa0ef9f4c70a94/users/6c5372ad0e0743efaa389d0a5d2b0075/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:51.314393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b2df6-c84c-4ac7-b023-00e62b8f8d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b88d9cb502d412f8ffa0ef9f4c70a94, user_id=6c5372ad0e0743efaa389d0a5d2b0075, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:51.316604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 865/1712] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:51.317151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b2df6-c84c-4ac7-b023-00e62b8f8d17 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:51.325176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176c9d-9125-4ac0-9e57-8d2bd4519e47 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:51.339819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 848/1713] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:51 2021] PUT /identity/v3/projects/1b88d9cb502d412f8ffa0ef9f4c70a94/users/6c5372ad0e0743efaa389d0a5d2b0075/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:51.351110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756054-51be-4307-a6b2-4f9d833d2771 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:51.352877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756054-51be-4307-a6b2-4f9d833d2771 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:51.352877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756054-51be-4307-a6b2-4f9d833d2771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:51.389409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176c9d-9125-4ac0-9e57-8d2bd4519e47 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:51.413449 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-84756054-51be-4307-a6b2-4f9d833d2771 None None] MFA Rules not processed for user `6c5372ad0e0743efaa389d0a5d2b0075`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:51.416901 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-84756054-51be-4307-a6b2-4f9d833d2771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:51.701466 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7217c1d-d309-4396-a287-d88adc592698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:51.702153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7217c1d-d309-4396-a287-d88adc592698 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:51.702879 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7217c1d-d309-4396-a287-d88adc592698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:51.702879 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7217c1d-d309-4396-a287-d88adc592698 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:51.703493 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7217c1d-d309-4396-a287-d88adc592698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:08:51.703842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7217c1d-d309-4396-a287-d88adc592698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:51.705403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7217c1d-d309-4396-a287-d88adc592698 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:51.707467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 849/1714] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:51 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:08:51.719872 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84756054-51be-4307-a6b2-4f9d833d2771 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:51.721841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-84756054-51be-4307-a6b2-4f9d833d2771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:51.749600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 866/1715] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:08:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:08:51.754282 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7217c1d-d309-4396-a287-d88adc592698 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:51.780353 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7217c1d-d309-4396-a287-d88adc592698 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:51.791772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b15e8-0133-4c79-a6d0-dd7e2b6bc678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:51.792767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b15e8-0133-4c79-a6d0-dd7e2b6bc678 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:51.793783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b15e8-0133-4c79-a6d0-dd7e2b6bc678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:51.794242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b15e8-0133-4c79-a6d0-dd7e2b6bc678 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:51.795312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b15e8-0133-4c79-a6d0-dd7e2b6bc678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:51.798877 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b15e8-0133-4c79-a6d0-dd7e2b6bc678 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:51.860250 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84756054-51be-4307-a6b2-4f9d833d2771 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:51.863037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 867/1716] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:51 2021] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:51.868031 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b15e8-0133-4c79-a6d0-dd7e2b6bc678 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:51.872529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f69d0-5a2b-40df-870b-c9e298a719e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:51.873259 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f69d0-5a2b-40df-870b-c9e298a719e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:51.873551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f69d0-5a2b-40df-870b-c9e298a719e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:51.873834 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f69d0-5a2b-40df-870b-c9e298a719e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:51.914267 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f69d0-5a2b-40df-870b-c9e298a719e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:51.931610 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f69d0-5a2b-40df-870b-c9e298a719e7 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:51.947528 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 850/1717] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:51 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:08:52.004287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b15e8-0133-4c79-a6d0-dd7e2b6bc678 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:52.010646 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf08e9-4b93-472b-9aeb-7809ad82626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:52.011797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf08e9-4b93-472b-9aeb-7809ad82626e admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:52.012837 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf08e9-4b93-472b-9aeb-7809ad82626e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:52.030732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf08e9-4b93-472b-9aeb-7809ad82626e admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:52.032756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf08e9-4b93-472b-9aeb-7809ad82626e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:52.035958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf08e9-4b93-472b-9aeb-7809ad82626e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:52.118460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f69d0-5a2b-40df-870b-c9e298a719e7 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:52.124764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 868/1718] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:51 2021] POST /identity/v3/users => generated 287 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:52.128333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf08e9-4b93-472b-9aeb-7809ad82626e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:52.131388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f69d0-5a2b-40df-870b-c9e298a719e7 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:52.186601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf08e9-4b93-472b-9aeb-7809ad82626e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:52.205324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259d08a-0cf4-427a-b920-926ebebba4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:52.206051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259d08a-0cf4-427a-b920-926ebebba4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:52.206453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259d08a-0cf4-427a-b920-926ebebba4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:52.206781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259d08a-0cf4-427a-b920-926ebebba4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:52.207590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259d08a-0cf4-427a-b920-926ebebba4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:52.209827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259d08a-0cf4-427a-b920-926ebebba4e8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:52.238833 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 869/1719] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:52 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:52.239904 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259d08a-0cf4-427a-b920-926ebebba4e8 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:52.263090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259d08a-0cf4-427a-b920-926ebebba4e8 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:52.274399 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab20256-18cb-48df-b7bb-7ef857653f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:52.275088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab20256-18cb-48df-b7bb-7ef857653f82 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:52.275369 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab20256-18cb-48df-b7bb-7ef857653f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:52.275643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab20256-18cb-48df-b7bb-7ef857653f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:52.276381 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab20256-18cb-48df-b7bb-7ef857653f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:52.280228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab20256-18cb-48df-b7bb-7ef857653f82 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:52.286891 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c8f3a-6997-47da-9828-9d70c1976922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:52.290647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c8f3a-6997-47da-9828-9d70c1976922 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:52.291150 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c8f3a-6997-47da-9828-9d70c1976922 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:52.291585 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c8f3a-6997-47da-9828-9d70c1976922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:52.296579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-167c8f3a-6997-47da-9828-9d70c1976922 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:52.301760 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 870/1720] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:52 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:52.319911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab20256-18cb-48df-b7bb-7ef857653f82 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:52.356626 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab20256-18cb-48df-b7bb-7ef857653f82 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:52.381498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647471e-6053-48b1-be15-0abea2d270fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:52.382552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647471e-6053-48b1-be15-0abea2d270fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:52.382885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647471e-6053-48b1-be15-0abea2d270fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:52.383893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647471e-6053-48b1-be15-0abea2d270fc admin admin] PATH_INFO: `/v3/projects/28b7615df51741dc90ffc0cc7da433e6/users/74439a9d005449dfbdfeb926e0a67d8d/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:52.441149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647471e-6053-48b1-be15-0abea2d270fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b7615df51741dc90ffc0cc7da433e6, user_id=74439a9d005449dfbdfeb926e0a67d8d, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:52.456853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647471e-6053-48b1-be15-0abea2d270fc admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:52.494454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c8f3a-6997-47da-9828-9d70c1976922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:52.495911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c8f3a-6997-47da-9828-9d70c1976922 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:52.508002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 851/1721] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:52 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:08:52.518653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 871/1722] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:52 2021] PUT /identity/v3/projects/28b7615df51741dc90ffc0cc7da433e6/users/74439a9d005449dfbdfeb926e0a67d8d/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:52.531084 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1fc2c-0b65-4db3-b68e-379053311e80 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:52.531329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1fc2c-0b65-4db3-b68e-379053311e80 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:52.531767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1fc2c-0b65-4db3-b68e-379053311e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:52.648149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-78e1fc2c-0b65-4db3-b68e-379053311e80 None None] MFA Rules not processed for user `74439a9d005449dfbdfeb926e0a67d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:52.650995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-78e1fc2c-0b65-4db3-b68e-379053311e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:52.700985 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747261d6-ec19-43f9-9c79-b5b700ade3c0 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:52.701174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747261d6-ec19-43f9-9c79-b5b700ade3c0 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:52.701430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747261d6-ec19-43f9-9c79-b5b700ade3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:52.767816 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 852/1723] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:52 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:52.772440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1fc2c-0b65-4db3-b68e-379053311e80 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:52.886005 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-747261d6-ec19-43f9-9c79-b5b700ade3c0 None None] MFA Rules not processed for user `62defd8645f7454699ee5c7bb5930d16`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:52.892183 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-747261d6-ec19-43f9-9c79-b5b700ade3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:53.060200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1fc2c-0b65-4db3-b68e-379053311e80 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:53.083651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86a6db-a7d0-495f-90f7-acf4bb1fab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:53.084425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86a6db-a7d0-495f-90f7-acf4bb1fab50 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:53.084712 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86a6db-a7d0-495f-90f7-acf4bb1fab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:53.084991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86a6db-a7d0-495f-90f7-acf4bb1fab50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:53.085696 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86a6db-a7d0-495f-90f7-acf4bb1fab50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:53.087683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86a6db-a7d0-495f-90f7-acf4bb1fab50 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:53.192227 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 872/1724] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:52 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:08:53.193871 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e69760-928f-472b-9578-b15d16583295 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:53.194310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e69760-928f-472b-9578-b15d16583295 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:53.194755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e69760-928f-472b-9578-b15d16583295 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:53.197090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 873/1725] 10.222.0.23 () {54 vars in 921 bytes} [Thu Dec 9 01:08:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:08:53.225228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 853/1726] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:08:52 2021] POST /identity/v3/projects => generated 371 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:53.226291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e69760-928f-472b-9578-b15d16583295 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:53.351283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d3af6-623a-4315-919a-6e23284d935e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:53.352493 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d3af6-623a-4315-919a-6e23284d935e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:53.352989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d3af6-623a-4315-919a-6e23284d935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:53.393776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-735d3af6-623a-4315-919a-6e23284d935e None None] MFA Rules not processed for user `53d32ba063bc4a719d4c2f67d88ec640`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:53.398276 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-735d3af6-623a-4315-919a-6e23284d935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:53.406606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e69760-928f-472b-9578-b15d16583295 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:53.417616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8420c89-2fa2-4721-859a-a5a76d6c6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:53.418980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8420c89-2fa2-4721-859a-a5a76d6c6db8 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:53.419450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8420c89-2fa2-4721-859a-a5a76d6c6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:53.419875 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8420c89-2fa2-4721-859a-a5a76d6c6db8 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:53.420745 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8420c89-2fa2-4721-859a-a5a76d6c6db8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:53.434911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8420c89-2fa2-4721-859a-a5a76d6c6db8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:53.508189 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 874/1727] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:08:53 2021] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:08:53.509176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8420c89-2fa2-4721-859a-a5a76d6c6db8 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:53.541377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8420c89-2fa2-4721-859a-a5a76d6c6db8 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:53.559935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f17d5-917d-4c13-a4b7-42623eda1cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:53.560619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f17d5-917d-4c13-a4b7-42623eda1cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:53.561071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f17d5-917d-4c13-a4b7-42623eda1cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:53.561649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f17d5-917d-4c13-a4b7-42623eda1cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:53.562585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f17d5-917d-4c13-a4b7-42623eda1cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:53.566734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f17d5-917d-4c13-a4b7-42623eda1cc4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:53.598831 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 875/1728] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:53 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:53.603030 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f17d5-917d-4c13-a4b7-42623eda1cc4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:53.635352 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f17d5-917d-4c13-a4b7-42623eda1cc4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:53.654465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3acdbd-6201-4de9-9718-54d47cd214bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:53.656431 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3acdbd-6201-4de9-9718-54d47cd214bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:53.661602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3acdbd-6201-4de9-9718-54d47cd214bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:53.663816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3acdbd-6201-4de9-9718-54d47cd214bd admin admin] PATH_INFO: `/v3/projects/92a17f0d7cfc4e88b34f2cdc150828a6/users/66c0104fcd634a0ca4b0379058b7d7a8/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:53.705356 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 854/1729] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Dec 9 01:08:53 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:08:53.743958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3acdbd-6201-4de9-9718-54d47cd214bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a17f0d7cfc4e88b34f2cdc150828a6, user_id=66c0104fcd634a0ca4b0379058b7d7a8, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:53.754921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3acdbd-6201-4de9-9718-54d47cd214bd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:53.812843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 876/1730] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:53 2021] PUT /identity/v3/projects/92a17f0d7cfc4e88b34f2cdc150828a6/users/66c0104fcd634a0ca4b0379058b7d7a8/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:53.816792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d3af6-623a-4315-919a-6e23284d935e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:53.837390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d3af6-623a-4315-919a-6e23284d935e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:54.056193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3acdbd-6201-4de9-9718-54d47cd214bd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:54.059459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-4c3acdbd-6201-4de9-9718-54d47cd214bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:54.068373 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22142127-36ae-4323-b71c-935ebaf8b5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:54.070492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22142127-36ae-4323-b71c-935ebaf8b5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:54.075947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22142127-36ae-4323-b71c-935ebaf8b5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:54.078796 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22142127-36ae-4323-b71c-935ebaf8b5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:54.080000 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22142127-36ae-4323-b71c-935ebaf8b5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:54.081863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22142127-36ae-4323-b71c-935ebaf8b5b7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:54.165638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 855/1731] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:08:53 2021] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:08:54.172463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22142127-36ae-4323-b71c-935ebaf8b5b7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:54.205336 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22142127-36ae-4323-b71c-935ebaf8b5b7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:54.208472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3acdbd-6201-4de9-9718-54d47cd214bd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:54.220608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1b059-2f47-4511-9df6-d1d1f16d1b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:54.222265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1b059-2f47-4511-9df6-d1d1f16d1b3f service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:54.222910 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1b059-2f47-4511-9df6-d1d1f16d1b3f service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:54.223649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1b059-2f47-4511-9df6-d1d1f16d1b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:54.236428 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a29ae-74e3-4153-b80e-9d28f1c663ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:54.237792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a29ae-74e3-4153-b80e-9d28f1c663ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:54.237792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a29ae-74e3-4153-b80e-9d28f1c663ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:54.238019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a29ae-74e3-4153-b80e-9d28f1c663ca admin admin] PATH_INFO: `/v3/projects/92a17f0d7cfc4e88b34f2cdc150828a6/users/66c0104fcd634a0ca4b0379058b7d7a8/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:54.257039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a29ae-74e3-4153-b80e-9d28f1c663ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a17f0d7cfc4e88b34f2cdc150828a6, user_id=66c0104fcd634a0ca4b0379058b7d7a8, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:54.272503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a29ae-74e3-4153-b80e-9d28f1c663ca admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:54.357325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 856/1732] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:08:54 2021] PUT /identity/v3/projects/92a17f0d7cfc4e88b34f2cdc150828a6/users/66c0104fcd634a0ca4b0379058b7d7a8/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:54.373579 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1b059-2f47-4511-9df6-d1d1f16d1b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:54.375670 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1b059-2f47-4511-9df6-d1d1f16d1b3f service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:54.403530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 877/1733] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:54 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:54.421055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4fef0-0f3f-490b-88e4-f34fb664711d None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:54.421961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4fef0-0f3f-490b-88e4-f34fb664711d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:54.422247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4fef0-0f3f-490b-88e4-f34fb664711d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:54.602588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-fcb4fef0-0f3f-490b-88e4-f34fb664711d None None] MFA Rules not processed for user `66c0104fcd634a0ca4b0379058b7d7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:54.603735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-fcb4fef0-0f3f-490b-88e4-f34fb664711d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:54.979580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1b059-2f47-4511-9df6-d1d1f16d1b3f service nova] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:54.982617 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-dcf1b059-2f47-4511-9df6-d1d1f16d1b3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:55.027320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1b059-2f47-4511-9df6-d1d1f16d1b3f service nova] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:55.090401 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 857/1734] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:54 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 670 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:55.163108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41040fe6-eb25-46f0-82c5-d67a6a020451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:55.163834 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41040fe6-eb25-46f0-82c5-d67a6a020451 service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:55.164124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41040fe6-eb25-46f0-82c5-d67a6a020451 service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:55.164442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41040fe6-eb25-46f0-82c5-d67a6a020451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:55.179515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41040fe6-eb25-46f0-82c5-d67a6a020451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:55.181195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41040fe6-eb25-46f0-82c5-d67a6a020451 service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:55.194829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 878/1735] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:54 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:08:55.897414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4fef0-0f3f-490b-88e4-f34fb664711d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:55.899911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-fcb4fef0-0f3f-490b-88e4-f34fb664711d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:56.101441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4fef0-0f3f-490b-88e4-f34fb664711d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:56.114038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8726c-a62d-4f5d-afd4-a632143e281c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:56.115155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8726c-a62d-4f5d-afd4-a632143e281c service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:56.118789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8726c-a62d-4f5d-afd4-a632143e281c service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:56.119455 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8726c-a62d-4f5d-afd4-a632143e281c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:56.175238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8726c-a62d-4f5d-afd4-a632143e281c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:56.181135 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8726c-a62d-4f5d-afd4-a632143e281c service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:56.242031 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 858/1736] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:55 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:56.875309 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41040fe6-eb25-46f0-82c5-d67a6a020451 service nova] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:57.036806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41040fe6-eb25-46f0-82c5-d67a6a020451 service nova] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:57.051689 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:57.053241 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:57.053843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:57.054312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] PATH_INFO: `/v3/users/74439a9d005449dfbdfeb926e0a67d8d` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:57.056796 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74439a9d005449dfbdfeb926e0a67d8d)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:57.060432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:57.182659 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74439a9d005449dfbdfeb926e0a67d8d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:57.183420 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74439a9d005449dfbdfeb926e0a67d8d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:57.197001 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74439a9d005449dfbdfeb926e0a67d8d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:57.198487 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74439a9d005449dfbdfeb926e0a67d8d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:57.239963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74439a9d005449dfbdfeb926e0a67d8d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:57.262506 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 879/1737] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:08:56 2021] DELETE /identity/v3/users/74439a9d005449dfbdfeb926e0a67d8d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:57.267549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b76ae-cc5c-4723-ba69-68ad60417559 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:57.268741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b76ae-cc5c-4723-ba69-68ad60417559 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:57.269236 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b76ae-cc5c-4723-ba69-68ad60417559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:57.309289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-768b76ae-cc5c-4723-ba69-68ad60417559 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:57.310870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-768b76ae-cc5c-4723-ba69-68ad60417559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:57.526162 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 859/1738] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:57.550004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:57.551916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:57.669395 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b76ae-cc5c-4723-ba69-68ad60417559 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:57.670925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-768b76ae-cc5c-4723-ba69-68ad60417559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:57.694226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b76ae-cc5c-4723-ba69-68ad60417559 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:57.720773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dfeb1-e518-49ec-b383-170841019974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:57.721942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dfeb1-e518-49ec-b383-170841019974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:57.722232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dfeb1-e518-49ec-b383-170841019974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:57.722543 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dfeb1-e518-49ec-b383-170841019974 admin admin] PATH_INFO: `/v3/users/d1ff457678b4427b8db04aea3990a150` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:57.739781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3453-4fdf-43cb-9da3-2e5355489281 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:57.740613 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dfeb1-e518-49ec-b383-170841019974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ff457678b4427b8db04aea3990a150)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:57.740613 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dfeb1-e518-49ec-b383-170841019974 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:57.748111 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b779-d502-40ae-bcb1-93c1b501a504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:57.748954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b779-d502-40ae-bcb1-93c1b501a504 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:57.749046 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b779-d502-40ae-bcb1-93c1b501a504 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:57.749331 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b779-d502-40ae-bcb1-93c1b501a504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:57.784828 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163b779-d502-40ae-bcb1-93c1b501a504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:57.786300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163b779-d502-40ae-bcb1-93c1b501a504 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:57.826267 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 880/1739] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:57.830990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e959bf-0482-4523-849c-4044709bcee0 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:57.833308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e959bf-0482-4523-849c-4044709bcee0 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:57.834115 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e959bf-0482-4523-849c-4044709bcee0 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:57.841384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 881/1740] 10.222.0.23 () {54 vars in 921 bytes} [Thu Dec 9 01:08:57 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:08:57.877001 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b2cc-6074-4216-b9df-7863aa9fd20e None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:57.878231 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b2cc-6074-4216-b9df-7863aa9fd20e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:57.878695 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b2cc-6074-4216-b9df-7863aa9fd20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:57.887442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-315dfeb1-e518-49ec-b383-170841019974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ff457678b4427b8db04aea3990a150'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:57.906552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-315dfeb1-e518-49ec-b383-170841019974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ff457678b4427b8db04aea3990a150'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:57.908022 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-315dfeb1-e518-49ec-b383-170841019974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ff457678b4427b8db04aea3990a150'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:57.910869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-315dfeb1-e518-49ec-b383-170841019974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ff457678b4427b8db04aea3990a150'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:57.926345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d064b2cc-6074-4216-b9df-7863aa9fd20e None None] MFA Rules not processed for user `53d32ba063bc4a719d4c2f67d88ec640`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:57.930125 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d064b2cc-6074-4216-b9df-7863aa9fd20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:57.956187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-315dfeb1-e518-49ec-b383-170841019974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ff457678b4427b8db04aea3990a150'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:08:57.992934 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 860/1741] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:08:57 2021] DELETE /identity/v3/users/d1ff457678b4427b8db04aea3990a150 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:08:57.998397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba432103-a85c-402e-9006-7002d83cedaf None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:57.999057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba432103-a85c-402e-9006-7002d83cedaf None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:57.999551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba432103-a85c-402e-9006-7002d83cedaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:58.061963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-ba432103-a85c-402e-9006-7002d83cedaf None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:08:58.063696 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ba432103-a85c-402e-9006-7002d83cedaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:58.198150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 882/1742] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Dec 9 01:08:57 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:58.314172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 861/1743] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:08:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:08:58.377781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b2cc-6074-4216-b9df-7863aa9fd20e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:58.379287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d064b2cc-6074-4216-b9df-7863aa9fd20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:58.402896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b2cc-6074-4216-b9df-7863aa9fd20e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:58.522814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee85ff2-0f4b-4873-acb7-bd1453268b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:58.523478 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee85ff2-0f4b-4873-acb7-bd1453268b56 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:58.523761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee85ff2-0f4b-4873-acb7-bd1453268b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:58.524038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee85ff2-0f4b-4873-acb7-bd1453268b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:58.560512 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee85ff2-0f4b-4873-acb7-bd1453268b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:58.562106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee85ff2-0f4b-4873-acb7-bd1453268b56 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:58.583203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 883/1744] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:08:59.100529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba432103-a85c-402e-9006-7002d83cedaf None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:08:59.102842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ba432103-a85c-402e-9006-7002d83cedaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:08:59.369649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba432103-a85c-402e-9006-7002d83cedaf None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:08:59.381430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5aa77-a9ff-439f-a020-d6aaba0e59a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:08:59.382150 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5aa77-a9ff-439f-a020-d6aaba0e59a2 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:08:59.382461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5aa77-a9ff-439f-a020-d6aaba0e59a2 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:08:59.382743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5aa77-a9ff-439f-a020-d6aaba0e59a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:08:59.408217 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5aa77-a9ff-439f-a020-d6aaba0e59a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:08:59.412353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5aa77-a9ff-439f-a020-d6aaba0e59a2 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:08:59.466534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 862/1745] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:08:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:00.252194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee85ff2-0f4b-4873-acb7-bd1453268b56 service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:00.253889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6ee85ff2-0f4b-4873-acb7-bd1453268b56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:00.283923 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee85ff2-0f4b-4873-acb7-bd1453268b56 service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:00.297907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:00.299365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:00.299865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:00.300137 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] PATH_INFO: `/v3/projects/28b7615df51741dc90ffc0cc7da433e6` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:00.302598 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b7615df51741dc90ffc0cc7da433e6)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:00.334054 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:00.466938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5aa77-a9ff-439f-a020-d6aaba0e59a2 service nova] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:00.468795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0fa5aa77-a9ff-439f-a020-d6aaba0e59a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:00.496976 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b7615df51741dc90ffc0cc7da433e6', 'request_id': 'req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:00.511567 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b7615df51741dc90ffc0cc7da433e6', 'request_id': 'req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:00.511800 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5aa77-a9ff-439f-a020-d6aaba0e59a2 service nova] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:00.524974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b7615df51741dc90ffc0cc7da433e6', 'request_id': 'req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:00.556320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] The token cache is being invalidate because project 28b7615df51741dc90ffc0cc7da433e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:00.557599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:00.559315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:00.567956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 884/1746] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:00 2021] DELETE /identity/v3/projects/28b7615df51741dc90ffc0cc7da433e6 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:00.572763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:00.576695 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:00.644232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a450251-e73b-442c-b52e-4030dc784827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:00.645570 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450251-e73b-442c-b52e-4030dc784827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:00.646041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450251-e73b-442c-b52e-4030dc784827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:00.646565 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450251-e73b-442c-b52e-4030dc784827 admin admin] PATH_INFO: `/v3/projects/39d572b3d19c4047b134e4f416b9e46e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:00.654392 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a450251-e73b-442c-b52e-4030dc784827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d572b3d19c4047b134e4f416b9e46e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:00.656935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a450251-e73b-442c-b52e-4030dc784827 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:00.777056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cf6b7-0289-4d32-9db3-4b57f1fbc464 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:00.781981 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7a450251-e73b-442c-b52e-4030dc784827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d572b3d19c4047b134e4f416b9e46e', 'request_id': 'req-7a450251-e73b-442c-b52e-4030dc784827'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:00.810039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7a450251-e73b-442c-b52e-4030dc784827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d572b3d19c4047b134e4f416b9e46e', 'request_id': 'req-7a450251-e73b-442c-b52e-4030dc784827'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:00.823231 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7a450251-e73b-442c-b52e-4030dc784827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d572b3d19c4047b134e4f416b9e46e', 'request_id': 'req-7a450251-e73b-442c-b52e-4030dc784827'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:00.878977 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7a450251-e73b-442c-b52e-4030dc784827 admin admin] The token cache is being invalidate because project 39d572b3d19c4047b134e4f416b9e46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:00.879254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7a450251-e73b-442c-b52e-4030dc784827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:00.883581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7a450251-e73b-442c-b52e-4030dc784827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:00.887315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 863/1747] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:00 2021] DELETE /identity/v3/projects/39d572b3d19c4047b134e4f416b9e46e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:00.896950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0fb7-7927-417a-b647-dad934397305 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:00.897812 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0fb7-7927-417a-b647-dad934397305 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:00.898269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0fb7-7927-417a-b647-dad934397305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:00.942713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-bb2e0fb7-7927-417a-b647-dad934397305 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:00.944101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-bb2e0fb7-7927-417a-b647-dad934397305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:01.028750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:01.029698 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:01.029983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:01.030256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] PATH_INFO: `/v3/users/66c0104fcd634a0ca4b0379058b7d7a8` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:01.045481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c0104fcd634a0ca4b0379058b7d7a8)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:01.059943 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:01.189670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 864/1748] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:01.198885 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892f75d-f9c0-43f4-ad47-d8a45347072a None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:01.200325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892f75d-f9c0-43f4-ad47-d8a45347072a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:01.200937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892f75d-f9c0-43f4-ad47-d8a45347072a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:01.263403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-f892f75d-f9c0-43f4-ad47-d8a45347072a None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:01.266385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f892f75d-f9c0-43f4-ad47-d8a45347072a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:01.302274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 865/1749] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:01.305448 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892f75d-f9c0-43f4-ad47-d8a45347072a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:01.339019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892f75d-f9c0-43f4-ad47-d8a45347072a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:01.357016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318acfd1-1436-4d8f-b493-f0d29f99bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:01.360295 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318acfd1-1436-4d8f-b493-f0d29f99bc2b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:01.361428 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318acfd1-1436-4d8f-b493-f0d29f99bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:01.364144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318acfd1-1436-4d8f-b493-f0d29f99bc2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:01.367810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318acfd1-1436-4d8f-b493-f0d29f99bc2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:01.369366 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318acfd1-1436-4d8f-b493-f0d29f99bc2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:01.373050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318acfd1-1436-4d8f-b493-f0d29f99bc2b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:01.422971 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 866/1750] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:09:01.425836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318acfd1-1436-4d8f-b493-f0d29f99bc2b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:01.455745 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318acfd1-1436-4d8f-b493-f0d29f99bc2b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:01.464515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37377dd-2cd7-4a44-ad7f-4a13dc4e78c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:01.465980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37377dd-2cd7-4a44-ad7f-4a13dc4e78c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:01.466498 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37377dd-2cd7-4a44-ad7f-4a13dc4e78c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:01.466934 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37377dd-2cd7-4a44-ad7f-4a13dc4e78c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:01.469439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37377dd-2cd7-4a44-ad7f-4a13dc4e78c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:01.477227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37377dd-2cd7-4a44-ad7f-4a13dc4e78c9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:01.546227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 867/1751] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:01 2021] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:01.550600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37377dd-2cd7-4a44-ad7f-4a13dc4e78c9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:01.560677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c0104fcd634a0ca4b0379058b7d7a8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:01.561408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c0104fcd634a0ca4b0379058b7d7a8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:01.579079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c0104fcd634a0ca4b0379058b7d7a8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:01.584585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c0104fcd634a0ca4b0379058b7d7a8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:01.612981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c0104fcd634a0ca4b0379058b7d7a8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:01.638991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 885/1752] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:00 2021] DELETE /identity/v3/users/66c0104fcd634a0ca4b0379058b7d7a8 => generated 0 bytes in 1067 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:01.707176 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37377dd-2cd7-4a44-ad7f-4a13dc4e78c9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:01.814480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21868241-01f9-4c31-a534-d87789118f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:01.817666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21868241-01f9-4c31-a534-d87789118f2f admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:01.817969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21868241-01f9-4c31-a534-d87789118f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:01.818255 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21868241-01f9-4c31-a534-d87789118f2f admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:01.819379 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21868241-01f9-4c31-a534-d87789118f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:01.823344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21868241-01f9-4c31-a534-d87789118f2f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:01.848232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 868/1753] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:01 2021] POST /identity/v3/users => generated 294 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:01.851914 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:01.854266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:01.873367 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc59da9-bbca-4965-b2ed-b1abde7309cc admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:01.879436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f6b16-d441-4093-83a7-72394a1ee156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:01.880274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f6b16-d441-4093-83a7-72394a1ee156 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:01.880663 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f6b16-d441-4093-83a7-72394a1ee156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:01.881068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f6b16-d441-4093-83a7-72394a1ee156 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:01.882203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f6b16-d441-4093-83a7-72394a1ee156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:01.884252 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f6b16-d441-4093-83a7-72394a1ee156 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:01.899468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 886/1754] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:01 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:01.905624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21868241-01f9-4c31-a534-d87789118f2f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:01.917953 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21868241-01f9-4c31-a534-d87789118f2f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:01.945889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940a204-dd4c-4147-97fa-9bafac083bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:01.949654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940a204-dd4c-4147-97fa-9bafac083bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:01.950006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940a204-dd4c-4147-97fa-9bafac083bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:01.950376 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940a204-dd4c-4147-97fa-9bafac083bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:01.951234 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940a204-dd4c-4147-97fa-9bafac083bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:01.955304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940a204-dd4c-4147-97fa-9bafac083bf7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:01.984861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 869/1755] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:01 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:01.989023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f6b16-d441-4093-83a7-72394a1ee156 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:02.000551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f6b16-d441-4093-83a7-72394a1ee156 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:02.006341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48469d-bd37-4fd0-9a27-cd472eb0eebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:02.007491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48469d-bd37-4fd0-9a27-cd472eb0eebe admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:02.007802 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48469d-bd37-4fd0-9a27-cd472eb0eebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:02.008100 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48469d-bd37-4fd0-9a27-cd472eb0eebe admin admin] PATH_INFO: `/v3/projects/9de507ba72884b839715367c90e1fea5/users/1cab79223f7a4cfaa698d1f687f0eb10/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:02.035565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48469d-bd37-4fd0-9a27-cd472eb0eebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de507ba72884b839715367c90e1fea5, user_id=1cab79223f7a4cfaa698d1f687f0eb10, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:02.041748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48469d-bd37-4fd0-9a27-cd472eb0eebe admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:02.062037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 887/1756] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:01 2021] PUT /identity/v3/projects/9de507ba72884b839715367c90e1fea5/users/1cab79223f7a4cfaa698d1f687f0eb10/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:02.115205 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36663d1-289d-46b1-b4a2-01cc4698db0b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:02.115535 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36663d1-289d-46b1-b4a2-01cc4698db0b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:02.115794 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36663d1-289d-46b1-b4a2-01cc4698db0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:02.161316 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c36663d1-289d-46b1-b4a2-01cc4698db0b None None] MFA Rules not processed for user `1cab79223f7a4cfaa698d1f687f0eb10`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:02.162538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c36663d1-289d-46b1-b4a2-01cc4698db0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:02.277501 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 870/1757] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:02 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:02.281906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48469d-bd37-4fd0-9a27-cd472eb0eebe admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:02.352246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48469d-bd37-4fd0-9a27-cd472eb0eebe admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:02.359717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddfc8b-9444-4f75-bb57-203cc7f31749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:02.360800 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddfc8b-9444-4f75-bb57-203cc7f31749 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:02.361131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddfc8b-9444-4f75-bb57-203cc7f31749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:02.361588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddfc8b-9444-4f75-bb57-203cc7f31749 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:02.362491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddfc8b-9444-4f75-bb57-203cc7f31749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:02.365171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddfc8b-9444-4f75-bb57-203cc7f31749 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:02.394063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 888/1758] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:02 2021] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:02.398255 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36663d1-289d-46b1-b4a2-01cc4698db0b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:02.410055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36663d1-289d-46b1-b4a2-01cc4698db0b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:02.446180 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c053-2df9-4d00-9be8-55593ccb903e None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:02.446448 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c053-2df9-4d00-9be8-55593ccb903e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:02.446732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c053-2df9-4d00-9be8-55593ccb903e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:02.476463 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a411c053-2df9-4d00-9be8-55593ccb903e None None] MFA Rules not processed for user `62defd8645f7454699ee5c7bb5930d16`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:02.477729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a411c053-2df9-4d00-9be8-55593ccb903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:02.504524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c3ba-424a-4f1e-aab1-a16f95693042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:02.505293 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c3ba-424a-4f1e-aab1-a16f95693042 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:02.505654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c3ba-424a-4f1e-aab1-a16f95693042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:02.506132 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c3ba-424a-4f1e-aab1-a16f95693042 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:02.507110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83c3ba-424a-4f1e-aab1-a16f95693042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:02.509112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83c3ba-424a-4f1e-aab1-a16f95693042 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:02.544695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 871/1759] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:02 2021] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:02.546037 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c3ba-424a-4f1e-aab1-a16f95693042 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:02.550825 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 889/1760] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:02 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:02.587471 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c3ba-424a-4f1e-aab1-a16f95693042 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:02.601662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a7e69-f012-4f71-8d22-6ad92ed951ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:02.604043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a7e69-f012-4f71-8d22-6ad92ed951ec admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:02.604969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a7e69-f012-4f71-8d22-6ad92ed951ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:02.607175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a7e69-f012-4f71-8d22-6ad92ed951ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:02.607469 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a7e69-f012-4f71-8d22-6ad92ed951ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:02.611405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a7e69-f012-4f71-8d22-6ad92ed951ec admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:02.622774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 872/1761] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:02 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:02.627495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411c053-2df9-4d00-9be8-55593ccb903e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:02.644619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411c053-2df9-4d00-9be8-55593ccb903e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:02.658107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83172ea2-832c-4633-a8f4-3af4b1c923e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:02.659156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83172ea2-832c-4633-a8f4-3af4b1c923e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:02.659444 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83172ea2-832c-4633-a8f4-3af4b1c923e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:02.659719 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83172ea2-832c-4633-a8f4-3af4b1c923e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:02.660683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83172ea2-832c-4633-a8f4-3af4b1c923e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:02.662668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83172ea2-832c-4633-a8f4-3af4b1c923e6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:02.677196 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 890/1762] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:02 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:02.681183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a7e69-f012-4f71-8d22-6ad92ed951ec admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:02.699960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a7e69-f012-4f71-8d22-6ad92ed951ec admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:02.705565 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92aeee-2dc6-4585-8df5-603f8807be3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:02.706654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92aeee-2dc6-4585-8df5-603f8807be3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:02.706948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92aeee-2dc6-4585-8df5-603f8807be3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:02.707219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92aeee-2dc6-4585-8df5-603f8807be3c admin admin] PATH_INFO: `/v3/projects/3156dfc6020c48a199c865b4c06f5f13/users/36aa024e19e34af38dae09608527b5de/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:02.729827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83172ea2-832c-4633-a8f4-3af4b1c923e6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:02.732417 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92aeee-2dc6-4585-8df5-603f8807be3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3156dfc6020c48a199c865b4c06f5f13, user_id=36aa024e19e34af38dae09608527b5de, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:02.732769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-83172ea2-832c-4633-a8f4-3af4b1c923e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:02.735449 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92aeee-2dc6-4585-8df5-603f8807be3c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:02.763273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83172ea2-832c-4633-a8f4-3af4b1c923e6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:02.772528 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 873/1763] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:02 2021] PUT /identity/v3/projects/3156dfc6020c48a199c865b4c06f5f13/users/36aa024e19e34af38dae09608527b5de/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:02.785192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a815dc-06bf-4c62-86d0-9732e57e5b50 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:02.785192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a815dc-06bf-4c62-86d0-9732e57e5b50 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:02.785192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a815dc-06bf-4c62-86d0-9732e57e5b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:02.830951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c7a815dc-06bf-4c62-86d0-9732e57e5b50 None None] MFA Rules not processed for user `36aa024e19e34af38dae09608527b5de`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:02.832110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c7a815dc-06bf-4c62-86d0-9732e57e5b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:02.879536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c75408-fa62-4e32-bddc-89e88e96c468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:02.881483 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c75408-fa62-4e32-bddc-89e88e96c468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:02.882439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c75408-fa62-4e32-bddc-89e88e96c468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:02.883677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c75408-fa62-4e32-bddc-89e88e96c468 admin admin] PATH_INFO: `/v3/projects/92a17f0d7cfc4e88b34f2cdc150828a6` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:02.885391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c75408-fa62-4e32-bddc-89e88e96c468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92a17f0d7cfc4e88b34f2cdc150828a6)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:02.888576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c75408-fa62-4e32-bddc-89e88e96c468 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:02.929696 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 874/1764] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:02 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:02.937466 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a815dc-06bf-4c62-86d0-9732e57e5b50 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:02.953913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a815dc-06bf-4c62-86d0-9732e57e5b50 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:02.958220 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-40c75408-fa62-4e32-bddc-89e88e96c468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92a17f0d7cfc4e88b34f2cdc150828a6', 'request_id': 'req-40c75408-fa62-4e32-bddc-89e88e96c468'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:02.968492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-40c75408-fa62-4e32-bddc-89e88e96c468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92a17f0d7cfc4e88b34f2cdc150828a6', 'request_id': 'req-40c75408-fa62-4e32-bddc-89e88e96c468'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:02.979489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-40c75408-fa62-4e32-bddc-89e88e96c468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92a17f0d7cfc4e88b34f2cdc150828a6', 'request_id': 'req-40c75408-fa62-4e32-bddc-89e88e96c468'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:02.999555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-40c75408-fa62-4e32-bddc-89e88e96c468 admin admin] The token cache is being invalidate because project 92a17f0d7cfc4e88b34f2cdc150828a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:03.000569 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-40c75408-fa62-4e32-bddc-89e88e96c468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:03.002046 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-40c75408-fa62-4e32-bddc-89e88e96c468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:03.004145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 891/1765] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:02 2021] DELETE /identity/v3/projects/92a17f0d7cfc4e88b34f2cdc150828a6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:03.010719 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304224f-2fbb-4e71-9e37-b068a1ad187d None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.011045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304224f-2fbb-4e71-9e37-b068a1ad187d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.011300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304224f-2fbb-4e71-9e37-b068a1ad187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.036066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a304224f-2fbb-4e71-9e37-b068a1ad187d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:03.037302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a304224f-2fbb-4e71-9e37-b068a1ad187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:03.158222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ad7fc-9476-4711-b71a-632c425fd414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:03.159091 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad7fc-9476-4711-b71a-632c425fd414 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.159324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad7fc-9476-4711-b71a-632c425fd414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.159603 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad7fc-9476-4711-b71a-632c425fd414 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.160328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ad7fc-9476-4711-b71a-632c425fd414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:03.162524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ad7fc-9476-4711-b71a-632c425fd414 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:03.164089 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 892/1766] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:03.173653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0916e8-1502-402d-b4c6-ce741fb82779 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.174245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0916e8-1502-402d-b4c6-ce741fb82779 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.174692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0916e8-1502-402d-b4c6-ce741fb82779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.204266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-bb0916e8-1502-402d-b4c6-ce741fb82779 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:03.207943 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-bb0916e8-1502-402d-b4c6-ce741fb82779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:03.217269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 875/1767] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:02 2021] POST /identity/v3/projects => generated 385 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:03.222152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ad7fc-9476-4711-b71a-632c425fd414 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:03.226948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-3e0ad7fc-9476-4711-b71a-632c425fd414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:03.235096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 893/1768] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:03.239788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0916e8-1502-402d-b4c6-ce741fb82779 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:03.261065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0916e8-1502-402d-b4c6-ce741fb82779 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:03.360425 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd211d-b644-4db0-afd1-a11bbd831962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:03.361157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd211d-b644-4db0-afd1-a11bbd831962 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.361747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd211d-b644-4db0-afd1-a11bbd831962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.362093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd211d-b644-4db0-afd1-a11bbd831962 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.362881 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd211d-b644-4db0-afd1-a11bbd831962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:03.363245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd211d-b644-4db0-afd1-a11bbd831962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:03.365122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd211d-b644-4db0-afd1-a11bbd831962 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:03.382831 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 894/1769] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:09:03.384836 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd211d-b644-4db0-afd1-a11bbd831962 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:03.393126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ad7fc-9476-4711-b71a-632c425fd414 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:03.405829 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac785-64ac-4b7f-b944-210d649a7604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:03.406504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac785-64ac-4b7f-b944-210d649a7604 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.406788 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac785-64ac-4b7f-b944-210d649a7604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.407375 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac785-64ac-4b7f-b944-210d649a7604 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.408102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ac785-64ac-4b7f-b944-210d649a7604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:03.408370 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd211d-b644-4db0-afd1-a11bbd831962 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:03.410988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ac785-64ac-4b7f-b944-210d649a7604 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:03.423436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda69adb-a213-4ada-87c7-ec0dccedc069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:03.424389 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda69adb-a213-4ada-87c7-ec0dccedc069 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.424803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda69adb-a213-4ada-87c7-ec0dccedc069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.425037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda69adb-a213-4ada-87c7-ec0dccedc069 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.425739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda69adb-a213-4ada-87c7-ec0dccedc069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:03.427686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda69adb-a213-4ada-87c7-ec0dccedc069 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:03.436843 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 876/1770] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:03 2021] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:03.441359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac785-64ac-4b7f-b944-210d649a7604 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:03.452720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac785-64ac-4b7f-b944-210d649a7604 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:03.461054 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68e049-df1a-4375-b568-7b1ab2c739ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:03.462503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68e049-df1a-4375-b568-7b1ab2c739ea admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.462503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68e049-df1a-4375-b568-7b1ab2c739ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.462927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68e049-df1a-4375-b568-7b1ab2c739ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.463851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68e049-df1a-4375-b568-7b1ab2c739ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:03.465661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68e049-df1a-4375-b568-7b1ab2c739ea admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:03.480418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 895/1772] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:03 2021] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:03.480634 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 877/1772] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:03 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:03.481714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda69adb-a213-4ada-87c7-ec0dccedc069 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:03.493510 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68e049-df1a-4375-b568-7b1ab2c739ea admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:03.521877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68e049-df1a-4375-b568-7b1ab2c739ea admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:03.636538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5f4d4-ff1e-4e80-ae39-2a01acb57868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:03.637770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5f4d4-ff1e-4e80-ae39-2a01acb57868 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.639689 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda69adb-a213-4ada-87c7-ec0dccedc069 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:03.641311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5f4d4-ff1e-4e80-ae39-2a01acb57868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.643071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5f4d4-ff1e-4e80-ae39-2a01acb57868 admin admin] PATH_INFO: `/v3/projects/0d95d2ac8e5b4f16a069681e3855beff/users/6015cdffac6846bd9e8c683c2699e4c8/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.645222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecad97-5394-446f-be4d-d53a44455b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:03.646214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecad97-5394-446f-be4d-d53a44455b91 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.646600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecad97-5394-446f-be4d-d53a44455b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.647209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecad97-5394-446f-be4d-d53a44455b91 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.648060 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecad97-5394-446f-be4d-d53a44455b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:03.650342 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecad97-5394-446f-be4d-d53a44455b91 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:03.685890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5f4d4-ff1e-4e80-ae39-2a01acb57868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d95d2ac8e5b4f16a069681e3855beff, user_id=6015cdffac6846bd9e8c683c2699e4c8, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:03.689025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5f4d4-ff1e-4e80-ae39-2a01acb57868 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:03.704078 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 896/1773] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:03 2021] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:03.707927 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecad97-5394-446f-be4d-d53a44455b91 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:03.725865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecad97-5394-446f-be4d-d53a44455b91 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:03.729978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 878/1774] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:03 2021] PUT /identity/v3/projects/0d95d2ac8e5b4f16a069681e3855beff/users/6015cdffac6846bd9e8c683c2699e4c8/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:03.731869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5f4d4-ff1e-4e80-ae39-2a01acb57868 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:03.848381 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a271b1-4f31-4d66-b607-03a2ae7948c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:03.849208 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a271b1-4f31-4d66-b607-03a2ae7948c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.852475 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a271b1-4f31-4d66-b607-03a2ae7948c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.852475 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a271b1-4f31-4d66-b607-03a2ae7948c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.853546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a271b1-4f31-4d66-b607-03a2ae7948c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:03.856265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a271b1-4f31-4d66-b607-03a2ae7948c7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:03.870640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 897/1775] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:03 2021] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:09:03.877008 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a271b1-4f31-4d66-b607-03a2ae7948c7 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:03.893172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a271b1-4f31-4d66-b607-03a2ae7948c7 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:03.901151 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaaa1f-2777-423b-870c-8c7eed02e278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:03.902358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaaa1f-2777-423b-870c-8c7eed02e278 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.902774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaaa1f-2777-423b-870c-8c7eed02e278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.903203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaaa1f-2777-423b-870c-8c7eed02e278 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.904113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaaa1f-2777-423b-870c-8c7eed02e278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:03.905913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5f4d4-ff1e-4e80-ae39-2a01acb57868 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:03.906693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaaa1f-2777-423b-870c-8c7eed02e278 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:03.913296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ae21f-d4a7-457a-89ea-7d505700cdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:03.914636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ae21f-d4a7-457a-89ea-7d505700cdaa admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.915080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ae21f-d4a7-457a-89ea-7d505700cdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.915503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ae21f-d4a7-457a-89ea-7d505700cdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.917082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ae21f-d4a7-457a-89ea-7d505700cdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:03.919455 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ae21f-d4a7-457a-89ea-7d505700cdaa admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:03.922427 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 898/1776] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:03 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:03.926043 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaaa1f-2777-423b-870c-8c7eed02e278 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:03.932499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 879/1777] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:03 2021] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:03.941057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ae21f-d4a7-457a-89ea-7d505700cdaa admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:03.947226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaaa1f-2777-423b-870c-8c7eed02e278 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:03.956188 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ae21f-d4a7-457a-89ea-7d505700cdaa admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:03.956754 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159119c-fd6a-4cff-8866-9deb660ef267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:03.958210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159119c-fd6a-4cff-8866-9deb660ef267 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.958538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159119c-fd6a-4cff-8866-9deb660ef267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.958880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159119c-fd6a-4cff-8866-9deb660ef267 admin admin] PATH_INFO: `/v3/projects/2b7cc8324e884f359ad1bb991d32425d/users/13c52cda42554447966a607bda765322/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.962751 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a2f3c-d9d9-4f1f-bef8-3cd0baa3849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:03.963910 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a2f3c-d9d9-4f1f-bef8-3cd0baa3849a admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:03.964411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a2f3c-d9d9-4f1f-bef8-3cd0baa3849a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:03.965148 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a2f3c-d9d9-4f1f-bef8-3cd0baa3849a admin admin] PATH_INFO: `/v3/projects/0d95d2ac8e5b4f16a069681e3855beff/users/6015cdffac6846bd9e8c683c2699e4c8/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:03.968327 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a2f3c-d9d9-4f1f-bef8-3cd0baa3849a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d95d2ac8e5b4f16a069681e3855beff, user_id=6015cdffac6846bd9e8c683c2699e4c8, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:03.971251 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a2f3c-d9d9-4f1f-bef8-3cd0baa3849a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:03.985872 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159119c-fd6a-4cff-8866-9deb660ef267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7cc8324e884f359ad1bb991d32425d, user_id=13c52cda42554447966a607bda765322, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:03.987628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 880/1778] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:03 2021] PUT /identity/v3/projects/0d95d2ac8e5b4f16a069681e3855beff/users/6015cdffac6846bd9e8c683c2699e4c8/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:03.989669 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159119c-fd6a-4cff-8866-9deb660ef267 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:03.999119 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139f4b-ca23-4a5c-81ff-c4874c7848f4 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:04.000300 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139f4b-ca23-4a5c-81ff-c4874c7848f4 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:04.000854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139f4b-ca23-4a5c-81ff-c4874c7848f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:04.023236 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 899/1779] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:03 2021] PUT /identity/v3/projects/2b7cc8324e884f359ad1bb991d32425d/users/13c52cda42554447966a607bda765322/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:04.025182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8f5f6-4d16-4e7d-863d-1d4d8c7f602d None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:04.025569 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8f5f6-4d16-4e7d-863d-1d4d8c7f602d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:04.025851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8f5f6-4d16-4e7d-863d-1d4d8c7f602d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:04.041962 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-8d139f4b-ca23-4a5c-81ff-c4874c7848f4 None None] MFA Rules not processed for user `6015cdffac6846bd9e8c683c2699e4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:04.044085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8d139f4b-ca23-4a5c-81ff-c4874c7848f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:04.055232 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-0dd8f5f6-4d16-4e7d-863d-1d4d8c7f602d None None] MFA Rules not processed for user `13c52cda42554447966a607bda765322`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:04.056530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0dd8f5f6-4d16-4e7d-863d-1d4d8c7f602d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:04.159178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 881/1780] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:03 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:04.170257 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d139f4b-ca23-4a5c-81ff-c4874c7848f4 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:04.172142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8d139f4b-ca23-4a5c-81ff-c4874c7848f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:04.200789 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 900/1781] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:04 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:04.205114 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8f5f6-4d16-4e7d-863d-1d4d8c7f602d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:04.240068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d139f4b-ca23-4a5c-81ff-c4874c7848f4 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:04.245397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40169b6-f73b-49f2-af4b-8c9c45cba93d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:04.246254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40169b6-f73b-49f2-af4b-8c9c45cba93d service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:04.246569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40169b6-f73b-49f2-af4b-8c9c45cba93d service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:04.246850 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40169b6-f73b-49f2-af4b-8c9c45cba93d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:04.265464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40169b6-f73b-49f2-af4b-8c9c45cba93d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:04.267209 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40169b6-f73b-49f2-af4b-8c9c45cba93d service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:04.288597 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 882/1782] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:04 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:09:04.289794 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8f5f6-4d16-4e7d-863d-1d4d8c7f602d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:04.295765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5a140-dbed-43dc-84eb-3f96cd26413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:04.296558 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a140-dbed-43dc-84eb-3f96cd26413c admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:04.296827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a140-dbed-43dc-84eb-3f96cd26413c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:04.297103 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a140-dbed-43dc-84eb-3f96cd26413c admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:04.297898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5a140-dbed-43dc-84eb-3f96cd26413c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:04.300526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5a140-dbed-43dc-84eb-3f96cd26413c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:04.345026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 901/1783] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:04 2021] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:04.350865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40169b6-f73b-49f2-af4b-8c9c45cba93d service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:04.366239 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40169b6-f73b-49f2-af4b-8c9c45cba93d service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:04.459018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4973f-a5ef-466d-8bc4-6d5c4e68b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:04.459934 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4973f-a5ef-466d-8bc4-6d5c4e68b760 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:04.460359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4973f-a5ef-466d-8bc4-6d5c4e68b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:04.460796 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4973f-a5ef-466d-8bc4-6d5c4e68b760 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:04.461867 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4973f-a5ef-466d-8bc4-6d5c4e68b760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:04.467540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4973f-a5ef-466d-8bc4-6d5c4e68b760 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:04.517881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 883/1784] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:04 2021] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:04.519679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5a140-dbed-43dc-84eb-3f96cd26413c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:04.530294 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5a140-dbed-43dc-84eb-3f96cd26413c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:04.547342 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666f2b-df14-465f-ae1c-d22aea483b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:04.548217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666f2b-df14-465f-ae1c-d22aea483b4c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:04.548543 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666f2b-df14-465f-ae1c-d22aea483b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:04.549007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666f2b-df14-465f-ae1c-d22aea483b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:04.550749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666f2b-df14-465f-ae1c-d22aea483b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:04.552663 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666f2b-df14-465f-ae1c-d22aea483b4c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:04.565783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 902/1785] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:04 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:04.571758 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4973f-a5ef-466d-8bc4-6d5c4e68b760 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:04.585105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4973f-a5ef-466d-8bc4-6d5c4e68b760 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:04.590987 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb4647-9889-443b-94a0-c6c41df4abbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:04.592082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb4647-9889-443b-94a0-c6c41df4abbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:04.592349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb4647-9889-443b-94a0-c6c41df4abbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:04.592721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb4647-9889-443b-94a0-c6c41df4abbb admin admin] PATH_INFO: `/v3/projects/a536a27212854fe3a75df8e4c008cbee/users/900272ec8b8a4f04b0b51206f8999b0d/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:04.631573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb4647-9889-443b-94a0-c6c41df4abbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a536a27212854fe3a75df8e4c008cbee, user_id=900272ec8b8a4f04b0b51206f8999b0d, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:04.636399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb4647-9889-443b-94a0-c6c41df4abbb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:04.665911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 884/1786] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:04 2021] PUT /identity/v3/projects/a536a27212854fe3a75df8e4c008cbee/users/900272ec8b8a4f04b0b51206f8999b0d/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:04.670897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666f2b-df14-465f-ae1c-d22aea483b4c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:04.683357 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666f2b-df14-465f-ae1c-d22aea483b4c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:04.838856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d1503-f10c-42bd-bac6-f13d19c838bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:04.839608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d1503-f10c-42bd-bac6-f13d19c838bd admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:04.840393 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d1503-f10c-42bd-bac6-f13d19c838bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:04.840686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d1503-f10c-42bd-bac6-f13d19c838bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:04.841671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d1503-f10c-42bd-bac6-f13d19c838bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:04.843391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d1503-f10c-42bd-bac6-f13d19c838bd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:04.867367 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 903/1787] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:04 2021] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:04.873106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb4647-9889-443b-94a0-c6c41df4abbb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:04.885243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb4647-9889-443b-94a0-c6c41df4abbb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:04.891598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8444b1c-0d1e-4c23-98e4-6c1748574635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:04.892748 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8444b1c-0d1e-4c23-98e4-6c1748574635 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:04.893429 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8444b1c-0d1e-4c23-98e4-6c1748574635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:04.893812 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8444b1c-0d1e-4c23-98e4-6c1748574635 admin admin] PATH_INFO: `/v3/projects/a536a27212854fe3a75df8e4c008cbee/users/900272ec8b8a4f04b0b51206f8999b0d/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:04.896200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8444b1c-0d1e-4c23-98e4-6c1748574635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a536a27212854fe3a75df8e4c008cbee, user_id=900272ec8b8a4f04b0b51206f8999b0d, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:04.899457 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8444b1c-0d1e-4c23-98e4-6c1748574635 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:04.922417 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 885/1788] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:04 2021] PUT /identity/v3/projects/a536a27212854fe3a75df8e4c008cbee/users/900272ec8b8a4f04b0b51206f8999b0d/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:04.924995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f86743-51d3-4146-8df1-9cf9c1c39bd2 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:04.925280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f86743-51d3-4146-8df1-9cf9c1c39bd2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:04.925687 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f86743-51d3-4146-8df1-9cf9c1c39bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:04.992799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-c1f86743-51d3-4146-8df1-9cf9c1c39bd2 None None] MFA Rules not processed for user `900272ec8b8a4f04b0b51206f8999b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:04.994047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c1f86743-51d3-4146-8df1-9cf9c1c39bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:05.218649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 904/1789] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:04 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:05.383518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8444b1c-0d1e-4c23-98e4-6c1748574635 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:05.588213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8444b1c-0d1e-4c23-98e4-6c1748574635 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:05.592787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16aa74-cfc3-49a9-b16a-491852fd772e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:05.593515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16aa74-cfc3-49a9-b16a-491852fd772e service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:05.593874 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16aa74-cfc3-49a9-b16a-491852fd772e service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:05.594224 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16aa74-cfc3-49a9-b16a-491852fd772e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:05.630492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16aa74-cfc3-49a9-b16a-491852fd772e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:05.632203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16aa74-cfc3-49a9-b16a-491852fd772e service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:05.658401 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 886/1790] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:05 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:05.934224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f86743-51d3-4146-8df1-9cf9c1c39bd2 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:05.936809 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c1f86743-51d3-4146-8df1-9cf9c1c39bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:05.968256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16aa74-cfc3-49a9-b16a-491852fd772e service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:05.979616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f86743-51d3-4146-8df1-9cf9c1c39bd2 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:05.983747 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16aa74-cfc3-49a9-b16a-491852fd772e service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:05.988621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b4e2b-1347-4c76-8851-cb61400949d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:05.989383 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b4e2b-1347-4c76-8851-cb61400949d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:05.989820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b4e2b-1347-4c76-8851-cb61400949d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:05.990348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b4e2b-1347-4c76-8851-cb61400949d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:05.993150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32301a5f-7b1a-4207-98a3-6fc2d3fc5759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:05.993826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301a5f-7b1a-4207-98a3-6fc2d3fc5759 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:05.993973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f92b4e2b-1347-4c76-8851-cb61400949d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:05.994147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301a5f-7b1a-4207-98a3-6fc2d3fc5759 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:05.994457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301a5f-7b1a-4207-98a3-6fc2d3fc5759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:06.134192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b4e2b-1347-4c76-8851-cb61400949d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:06.138970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b4e2b-1347-4c76-8851-cb61400949d8 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:06.147060 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32301a5f-7b1a-4207-98a3-6fc2d3fc5759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:06.149102 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32301a5f-7b1a-4207-98a3-6fc2d3fc5759 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:06.160971 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 887/1791] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:05 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:06.168354 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 905/1792] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:05 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:09.639484 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b4e2b-1347-4c76-8851-cb61400949d8 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:09.766496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b4e2b-1347-4c76-8851-cb61400949d8 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:09.777284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:09.778210 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:09.778546 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:09.778826 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] PATH_INFO: `/v3/users/13c52cda42554447966a607bda765322` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:09.780107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c52cda42554447966a607bda765322)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:09.782042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:09.877609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c52cda42554447966a607bda765322'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:09.901393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c52cda42554447966a607bda765322'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:09.903660 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c52cda42554447966a607bda765322'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:09.907841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c52cda42554447966a607bda765322'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:09.926827 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c52cda42554447966a607bda765322'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:09.946012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 888/1793] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:09 2021] DELETE /identity/v3/users/13c52cda42554447966a607bda765322 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:09.951389 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fa40c-3d2f-4878-9e96-15592c13de4c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:09.952471 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fa40c-3d2f-4878-9e96-15592c13de4c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:09.952900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fa40c-3d2f-4878-9e96-15592c13de4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:09.981803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-af5fa40c-3d2f-4878-9e96-15592c13de4c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:09.983238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-af5fa40c-3d2f-4878-9e96-15592c13de4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:10.062429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 906/1794] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:10.069450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:10.072182 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:10.142856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db968f-2f80-4242-baca-758087929b98 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:10.146741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab663a6-2659-4c3d-bf72-89679f63846a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:10.147392 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab663a6-2659-4c3d-bf72-89679f63846a service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:10.147678 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab663a6-2659-4c3d-bf72-89679f63846a service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:10.147957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab663a6-2659-4c3d-bf72-89679f63846a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:10.158053 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab663a6-2659-4c3d-bf72-89679f63846a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:10.159798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab663a6-2659-4c3d-bf72-89679f63846a service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:10.169979 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 889/1795] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:10.490797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fa40c-3d2f-4878-9e96-15592c13de4c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:10.492287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-af5fa40c-3d2f-4878-9e96-15592c13de4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:10.506418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fa40c-3d2f-4878-9e96-15592c13de4c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:10.512733 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:10.516090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:10.516412 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:10.516699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] PATH_INFO: `/v3/projects/2b7cc8324e884f359ad1bb991d32425d` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:10.519273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7cc8324e884f359ad1bb991d32425d)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:10.521355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:10.570012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7cc8324e884f359ad1bb991d32425d', 'request_id': 'req-344f0e24-3734-42a5-bf66-a0c51b03fa83'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:10.578069 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7cc8324e884f359ad1bb991d32425d', 'request_id': 'req-344f0e24-3734-42a5-bf66-a0c51b03fa83'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:10.587431 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7cc8324e884f359ad1bb991d32425d', 'request_id': 'req-344f0e24-3734-42a5-bf66-a0c51b03fa83'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:10.602108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] The token cache is being invalidate because project 2b7cc8324e884f359ad1bb991d32425d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:10.602433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:10.603103 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:10.604672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 907/1796] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:10 2021] DELETE /identity/v3/projects/2b7cc8324e884f359ad1bb991d32425d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:10.609134 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab663a6-2659-4c3d-bf72-89679f63846a service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:10.618674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab663a6-2659-4c3d-bf72-89679f63846a service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:10.673988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66abeb-0b16-4a82-bf84-32b3fa963cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:10.674874 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66abeb-0b16-4a82-bf84-32b3fa963cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:10.675153 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66abeb-0b16-4a82-bf84-32b3fa963cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:10.675427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66abeb-0b16-4a82-bf84-32b3fa963cfe admin admin] PATH_INFO: `/v3/users/900272ec8b8a4f04b0b51206f8999b0d` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:10.676602 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66abeb-0b16-4a82-bf84-32b3fa963cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=900272ec8b8a4f04b0b51206f8999b0d)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:10.678536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66abeb-0b16-4a82-bf84-32b3fa963cfe admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:10.721064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ec66abeb-0b16-4a82-bf84-32b3fa963cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900272ec8b8a4f04b0b51206f8999b0d'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:10.727707 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ec66abeb-0b16-4a82-bf84-32b3fa963cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900272ec8b8a4f04b0b51206f8999b0d'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:10.728351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ec66abeb-0b16-4a82-bf84-32b3fa963cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900272ec8b8a4f04b0b51206f8999b0d'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:10.728965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ec66abeb-0b16-4a82-bf84-32b3fa963cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900272ec8b8a4f04b0b51206f8999b0d'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:10.740055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ec66abeb-0b16-4a82-bf84-32b3fa963cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900272ec8b8a4f04b0b51206f8999b0d'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:10.752402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 890/1797] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:10 2021] DELETE /identity/v3/users/900272ec8b8a4f04b0b51206f8999b0d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:11.032019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:11.033456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:11.049472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f0e24-3734-42a5-bf66-a0c51b03fa83 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:11.107382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:11.108230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.108510 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.108777 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da admin admin] PATH_INFO: `/v3/projects/a536a27212854fe3a75df8e4c008cbee` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.109955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a536a27212854fe3a75df8e4c008cbee)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:11.111875 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:11.156385 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a536a27212854fe3a75df8e4c008cbee', 'request_id': 'req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:11.162183 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a536a27212854fe3a75df8e4c008cbee', 'request_id': 'req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:11.169281 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a536a27212854fe3a75df8e4c008cbee', 'request_id': 'req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:11.179439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da admin admin] The token cache is being invalidate because project a536a27212854fe3a75df8e4c008cbee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:11.179727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:11.180355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4f8edc52-ac92-4dcb-9a68-6e5fd698e9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:11.181874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 908/1798] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:11 2021] DELETE /identity/v3/projects/a536a27212854fe3a75df8e4c008cbee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:11.188534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56f685-bda4-44fb-b720-06c092e92cdb None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.188825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56f685-bda4-44fb-b720-06c092e92cdb None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.189107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56f685-bda4-44fb-b720-06c092e92cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.208541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-0e56f685-bda4-44fb-b720-06c092e92cdb None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:11.209743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0e56f685-bda4-44fb-b720-06c092e92cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:11.267994 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 891/1799] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:11.275767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b10de-48e5-45cf-b2bc-000fd38ea85c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.276056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b10de-48e5-45cf-b2bc-000fd38ea85c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.276334 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b10de-48e5-45cf-b2bc-000fd38ea85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.296747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-cf6b10de-48e5-45cf-b2bc-000fd38ea85c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:11.298246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cf6b10de-48e5-45cf-b2bc-000fd38ea85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:11.311136 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 909/1800] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:11.312351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56f685-bda4-44fb-b720-06c092e92cdb None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:11.322514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56f685-bda4-44fb-b720-06c092e92cdb None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:11.328140 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190adf71-76c9-443e-a1b6-3b8af0faaa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:11.329107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190adf71-76c9-443e-a1b6-3b8af0faaa52 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.329596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190adf71-76c9-443e-a1b6-3b8af0faaa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.330080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190adf71-76c9-443e-a1b6-3b8af0faaa52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.331297 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190adf71-76c9-443e-a1b6-3b8af0faaa52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:11.331607 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190adf71-76c9-443e-a1b6-3b8af0faaa52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:11.333216 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190adf71-76c9-443e-a1b6-3b8af0faaa52 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:11.348803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 892/1801] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:09:11.353048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b10de-48e5-45cf-b2bc-000fd38ea85c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:11.363225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b10de-48e5-45cf-b2bc-000fd38ea85c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:11.367947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b6398-aefa-4012-a98d-d4a043fa249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:11.368605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b6398-aefa-4012-a98d-d4a043fa249c admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.368888 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b6398-aefa-4012-a98d-d4a043fa249c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.369165 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b6398-aefa-4012-a98d-d4a043fa249c admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.369902 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b6398-aefa-4012-a98d-d4a043fa249c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:11.372806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b6398-aefa-4012-a98d-d4a043fa249c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:11.403410 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 910/1802] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:11 2021] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:11.405273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190adf71-76c9-443e-a1b6-3b8af0faaa52 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:11.416892 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190adf71-76c9-443e-a1b6-3b8af0faaa52 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:11.475865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505acb0b-4f1b-452d-9172-d84cdd1d3bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:11.476520 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505acb0b-4f1b-452d-9172-d84cdd1d3bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.476801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505acb0b-4f1b-452d-9172-d84cdd1d3bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.477075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505acb0b-4f1b-452d-9172-d84cdd1d3bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.477780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505acb0b-4f1b-452d-9172-d84cdd1d3bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:11.479837 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505acb0b-4f1b-452d-9172-d84cdd1d3bf7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:11.499428 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 893/1803] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:11 2021] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:11.503643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b6398-aefa-4012-a98d-d4a043fa249c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:11.514679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b6398-aefa-4012-a98d-d4a043fa249c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:11.519355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5923b4a-8796-438c-8d3e-e87997a53626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:11.520072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5923b4a-8796-438c-8d3e-e87997a53626 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.520239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5923b4a-8796-438c-8d3e-e87997a53626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.520537 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5923b4a-8796-438c-8d3e-e87997a53626 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.521255 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5923b4a-8796-438c-8d3e-e87997a53626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:11.523304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5923b4a-8796-438c-8d3e-e87997a53626 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:11.535531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 911/1804] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:11 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:11.539702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505acb0b-4f1b-452d-9172-d84cdd1d3bf7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:11.549560 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505acb0b-4f1b-452d-9172-d84cdd1d3bf7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:11.554283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7b8f9-5497-4ac6-a644-5a09e44acc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:11.554985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7b8f9-5497-4ac6-a644-5a09e44acc4d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.555272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7b8f9-5497-4ac6-a644-5a09e44acc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.555553 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7b8f9-5497-4ac6-a644-5a09e44acc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.556323 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7b8f9-5497-4ac6-a644-5a09e44acc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:11.557930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7b8f9-5497-4ac6-a644-5a09e44acc4d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:11.568414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 894/1805] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:11.572721 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5923b4a-8796-438c-8d3e-e87997a53626 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:11.583454 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5923b4a-8796-438c-8d3e-e87997a53626 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:11.593504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b11df-4662-4c40-9051-7f594494bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:11.594471 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b11df-4662-4c40-9051-7f594494bb11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.594759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b11df-4662-4c40-9051-7f594494bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.595035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b11df-4662-4c40-9051-7f594494bb11 admin admin] PATH_INFO: `/v3/projects/c0cf2ca0003a4207b4d98012435eed8c/users/4dadac61b91d408bb44cd829b7220e32/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.611694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b11df-4662-4c40-9051-7f594494bb11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cf2ca0003a4207b4d98012435eed8c, user_id=4dadac61b91d408bb44cd829b7220e32, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:11.614636 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b11df-4662-4c40-9051-7f594494bb11 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:11.634605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 912/1806] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:11 2021] PUT /identity/v3/projects/c0cf2ca0003a4207b4d98012435eed8c/users/4dadac61b91d408bb44cd829b7220e32/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:11.644456 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b09d5-e148-4fa0-98ba-d96a1a80b314 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.644746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b09d5-e148-4fa0-98ba-d96a1a80b314 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.645024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b09d5-e148-4fa0-98ba-d96a1a80b314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.677612 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-544b09d5-e148-4fa0-98ba-d96a1a80b314 None None] MFA Rules not processed for user `4dadac61b91d408bb44cd829b7220e32`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:11.678869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-544b09d5-e148-4fa0-98ba-d96a1a80b314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:11.751050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 895/1807] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:11 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:11.763013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b11df-4662-4c40-9051-7f594494bb11 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:11.823247 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b11df-4662-4c40-9051-7f594494bb11 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:11.828039 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e652f-af76-4786-93cf-9b20685c390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:11.828694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e652f-af76-4786-93cf-9b20685c390a admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.828986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e652f-af76-4786-93cf-9b20685c390a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.829257 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e652f-af76-4786-93cf-9b20685c390a admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.829957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e652f-af76-4786-93cf-9b20685c390a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:11.831947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e652f-af76-4786-93cf-9b20685c390a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:11.864584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 913/1808] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:11 2021] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:11.865770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b09d5-e148-4fa0-98ba-d96a1a80b314 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:11.876598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b09d5-e148-4fa0-98ba-d96a1a80b314 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:11.932925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a64e-ef9c-4a09-b71d-9aea7826fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:11.934163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a64e-ef9c-4a09-b71d-9aea7826fb1e admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.934552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a64e-ef9c-4a09-b71d-9aea7826fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.934833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a64e-ef9c-4a09-b71d-9aea7826fb1e admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.935531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2a64e-ef9c-4a09-b71d-9aea7826fb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:11.937478 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2a64e-ef9c-4a09-b71d-9aea7826fb1e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:11.957361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 896/1809] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:11 2021] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:11.961128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e652f-af76-4786-93cf-9b20685c390a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:11.971865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e652f-af76-4786-93cf-9b20685c390a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:11.976400 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877d978-ff1d-4a95-a135-c67854173d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:11.977057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877d978-ff1d-4a95-a135-c67854173d45 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:11.977338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877d978-ff1d-4a95-a135-c67854173d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:11.977613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877d978-ff1d-4a95-a135-c67854173d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:11.978350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877d978-ff1d-4a95-a135-c67854173d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:11.980503 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877d978-ff1d-4a95-a135-c67854173d45 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:11.991343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 914/1810] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:11.996131 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a64e-ef9c-4a09-b71d-9aea7826fb1e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:12.006295 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a64e-ef9c-4a09-b71d-9aea7826fb1e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:12.011312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b525a7-e31c-46da-974c-5fa4d324ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:12.012531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b525a7-e31c-46da-974c-5fa4d324ce1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:12.012813 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b525a7-e31c-46da-974c-5fa4d324ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:12.013090 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b525a7-e31c-46da-974c-5fa4d324ce1c admin admin] PATH_INFO: `/v3/projects/9ad12d9abe1d421d99a06e482e92d77e/users/48b237b9a7bc41a0be46ab6e456bed85/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:12.028274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b525a7-e31c-46da-974c-5fa4d324ce1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad12d9abe1d421d99a06e482e92d77e, user_id=48b237b9a7bc41a0be46ab6e456bed85, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:12.030961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b525a7-e31c-46da-974c-5fa4d324ce1c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:12.047534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 897/1811] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:11 2021] PUT /identity/v3/projects/9ad12d9abe1d421d99a06e482e92d77e/users/48b237b9a7bc41a0be46ab6e456bed85/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:12.051444 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877d978-ff1d-4a95-a135-c67854173d45 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:12.062541 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877d978-ff1d-4a95-a135-c67854173d45 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:12.123204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1a8bd-203f-4aba-b96f-da9eb250e0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:12.123871 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1a8bd-203f-4aba-b96f-da9eb250e0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:12.124157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1a8bd-203f-4aba-b96f-da9eb250e0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:12.124441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1a8bd-203f-4aba-b96f-da9eb250e0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:12.125178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1a8bd-203f-4aba-b96f-da9eb250e0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:12.126816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1a8bd-203f-4aba-b96f-da9eb250e0a0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:12.137009 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 915/1812] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:12 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:12.140961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b525a7-e31c-46da-974c-5fa4d324ce1c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:12.151081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b525a7-e31c-46da-974c-5fa4d324ce1c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:12.156919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde0eae-b5e7-4860-beba-1d18dd8fe02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:12.157805 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde0eae-b5e7-4860-beba-1d18dd8fe02a admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:12.158122 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde0eae-b5e7-4860-beba-1d18dd8fe02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:12.158438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde0eae-b5e7-4860-beba-1d18dd8fe02a admin admin] PATH_INFO: `/v3/projects/9ad12d9abe1d421d99a06e482e92d77e/users/48b237b9a7bc41a0be46ab6e456bed85/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:12.160483 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde0eae-b5e7-4860-beba-1d18dd8fe02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad12d9abe1d421d99a06e482e92d77e, user_id=48b237b9a7bc41a0be46ab6e456bed85, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:12.163251 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde0eae-b5e7-4860-beba-1d18dd8fe02a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:12.174132 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 898/1813] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:12 2021] PUT /identity/v3/projects/9ad12d9abe1d421d99a06e482e92d77e/users/48b237b9a7bc41a0be46ab6e456bed85/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:12.185011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80809d-0eb3-4f13-b2ab-e322d4d9c635 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:12.185302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80809d-0eb3-4f13-b2ab-e322d4d9c635 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:12.185582 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80809d-0eb3-4f13-b2ab-e322d4d9c635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:12.211564 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9c80809d-0eb3-4f13-b2ab-e322d4d9c635 None None] MFA Rules not processed for user `48b237b9a7bc41a0be46ab6e456bed85`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:12.212782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9c80809d-0eb3-4f13-b2ab-e322d4d9c635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:12.278499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 916/1814] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:12 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:12.288257 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde0eae-b5e7-4860-beba-1d18dd8fe02a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:12.290018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5dde0eae-b5e7-4860-beba-1d18dd8fe02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:12.344123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde0eae-b5e7-4860-beba-1d18dd8fe02a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:12.348017 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f4567-3515-4c26-88f6-28adf84970e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:12.348656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f4567-3515-4c26-88f6-28adf84970e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:12.348936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f4567-3515-4c26-88f6-28adf84970e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:12.349534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f4567-3515-4c26-88f6-28adf84970e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:12.359337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f4567-3515-4c26-88f6-28adf84970e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:12.360819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f4567-3515-4c26-88f6-28adf84970e6 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:12.371424 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 899/1815] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:12 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:12.481514 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80809d-0eb3-4f13-b2ab-e322d4d9c635 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:12.494428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80809d-0eb3-4f13-b2ab-e322d4d9c635 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:12.504701 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544261c-0cbd-4c90-bf4d-edb523d9488c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:12.505677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544261c-0cbd-4c90-bf4d-edb523d9488c service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:12.506166 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544261c-0cbd-4c90-bf4d-edb523d9488c service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:12.506529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544261c-0cbd-4c90-bf4d-edb523d9488c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:12.578511 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544261c-0cbd-4c90-bf4d-edb523d9488c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:12.580129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544261c-0cbd-4c90-bf4d-edb523d9488c service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:12.590232 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 917/1816] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:12 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:14.407611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f4567-3515-4c26-88f6-28adf84970e6 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:14.409107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b72f4567-3515-4c26-88f6-28adf84970e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:14.500331 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f4567-3515-4c26-88f6-28adf84970e6 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:14.506195 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:14.507576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:14.507825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:14.508368 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] PATH_INFO: `/v3/users/9de6ccd3eb024742b3ca0b48f1ed244e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:14.516176 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de6ccd3eb024742b3ca0b48f1ed244e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:14.518516 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:14.591053 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de6ccd3eb024742b3ca0b48f1ed244e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:14.613394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de6ccd3eb024742b3ca0b48f1ed244e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:14.614459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de6ccd3eb024742b3ca0b48f1ed244e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:14.615301 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de6ccd3eb024742b3ca0b48f1ed244e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:14.632029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de6ccd3eb024742b3ca0b48f1ed244e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:14.651302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 900/1817] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:14 2021] DELETE /identity/v3/users/9de6ccd3eb024742b3ca0b48f1ed244e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:14.656379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c1fde-d89d-4479-9c3e-fcda63a1ea26 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:14.656830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c1fde-d89d-4479-9c3e-fcda63a1ea26 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:14.657226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c1fde-d89d-4479-9c3e-fcda63a1ea26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:14.675486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:14.677033 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:14.684662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-257c1fde-d89d-4479-9c3e-fcda63a1ea26 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:14.686050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-257c1fde-d89d-4479-9c3e-fcda63a1ea26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:14.744690 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa059ce5-08da-491c-9233-11d5b43fcbab admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:14.750463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba60e2-2d7d-4d83-bbaf-85edfcdeb327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:14.751351 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 918/1818] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:14.751616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba60e2-2d7d-4d83-bbaf-85edfcdeb327 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:14.751989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba60e2-2d7d-4d83-bbaf-85edfcdeb327 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:14.752342 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba60e2-2d7d-4d83-bbaf-85edfcdeb327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:14.754245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8aba60e2-2d7d-4d83-bbaf-85edfcdeb327 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:14.764042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c1fde-d89d-4479-9c3e-fcda63a1ea26 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:14.765499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-257c1fde-d89d-4479-9c3e-fcda63a1ea26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:14.849377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba60e2-2d7d-4d83-bbaf-85edfcdeb327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:14.851737 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba60e2-2d7d-4d83-bbaf-85edfcdeb327 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:14.863558 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 901/1819] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:14 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:14.874259 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c1fde-d89d-4479-9c3e-fcda63a1ea26 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:14.878633 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6372f3b-63f7-433e-bea0-c52a9a51a90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:14.879613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6372f3b-63f7-433e-bea0-c52a9a51a90b service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:14.880072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6372f3b-63f7-433e-bea0-c52a9a51a90b service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:14.880527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6372f3b-63f7-433e-bea0-c52a9a51a90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:14.894168 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6372f3b-63f7-433e-bea0-c52a9a51a90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:14.896337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6372f3b-63f7-433e-bea0-c52a9a51a90b service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:14.913121 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 919/1820] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:09:14.937830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0cd0b-be63-46f1-8da6-8e3617e013fe None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:14.937830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0cd0b-be63-46f1-8da6-8e3617e013fe None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:14.938125 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0cd0b-be63-46f1-8da6-8e3617e013fe None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:14.940142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 902/1821] 10.222.0.23 () {54 vars in 921 bytes} [Thu Dec 9 01:09:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:09:14.956774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fca076-cd50-447b-bfdd-27dac0554370 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:14.956882 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fca076-cd50-447b-bfdd-27dac0554370 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:14.957162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fca076-cd50-447b-bfdd-27dac0554370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:14.988929 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-63fca076-cd50-447b-bfdd-27dac0554370 None None] MFA Rules not processed for user `53d32ba063bc4a719d4c2f67d88ec640`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:14.990347 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-63fca076-cd50-447b-bfdd-27dac0554370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:15.098304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 920/1822] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Dec 9 01:09:14 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:15.123002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0cd0b-be63-46f1-8da6-8e3617e013fe None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:15.126838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-cdc0cd0b-be63-46f1-8da6-8e3617e013fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:15.173496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0cd0b-be63-46f1-8da6-8e3617e013fe None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:15.193075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e0b26-ee00-408f-bbcf-4d71577bb409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:15.193784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e0b26-ee00-408f-bbcf-4d71577bb409 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:15.194336 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e0b26-ee00-408f-bbcf-4d71577bb409 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:15.194645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e0b26-ee00-408f-bbcf-4d71577bb409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:15.211820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e0b26-ee00-408f-bbcf-4d71577bb409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:15.213409 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e0b26-ee00-408f-bbcf-4d71577bb409 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:15.236441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 903/1823] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:09:15.449873 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fca076-cd50-447b-bfdd-27dac0554370 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:15.451981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-63fca076-cd50-447b-bfdd-27dac0554370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:15.473517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fca076-cd50-447b-bfdd-27dac0554370 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:15.480821 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:15.482102 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:15.482661 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:15.483176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] PATH_INFO: `/v3/users/4dadac61b91d408bb44cd829b7220e32` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:15.486211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dadac61b91d408bb44cd829b7220e32)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:15.488907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:15.586496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dadac61b91d408bb44cd829b7220e32'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:15.587666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dadac61b91d408bb44cd829b7220e32'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:15.599959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dadac61b91d408bb44cd829b7220e32'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:15.601429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dadac61b91d408bb44cd829b7220e32'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:15.622868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dadac61b91d408bb44cd829b7220e32'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:15.640498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 921/1824] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:15 2021] DELETE /identity/v3/users/4dadac61b91d408bb44cd829b7220e32 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:15.645421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d40ca-f09c-43df-bc87-1f84c032ebd3 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:15.645911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d40ca-f09c-43df-bc87-1f84c032ebd3 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:15.646001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d40ca-f09c-43df-bc87-1f84c032ebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:15.688617 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-ca3d40ca-f09c-43df-bc87-1f84c032ebd3 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:15.689697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ca3d40ca-f09c-43df-bc87-1f84c032ebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:15.831299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 904/1825] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:15.852804 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:15.855653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:15.979113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc53b8e-6bad-436d-a09e-b41edda5d471 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:15.988836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d40ca-f09c-43df-bc87-1f84c032ebd3 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:15.989989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d9e0b-2702-4b23-9cc4-9bd4c00cf713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:15.991051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d9e0b-2702-4b23-9cc4-9bd4c00cf713 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:15.991761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ca3d40ca-f09c-43df-bc87-1f84c032ebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:16.000475 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d9e0b-2702-4b23-9cc4-9bd4c00cf713 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:16.000904 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d9e0b-2702-4b23-9cc4-9bd4c00cf713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:16.010487 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d40ca-f09c-43df-bc87-1f84c032ebd3 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:16.012558 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d9e0b-2702-4b23-9cc4-9bd4c00cf713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:16.014193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d9e0b-2702-4b23-9cc4-9bd4c00cf713 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:16.016184 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:16.018138 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:16.019390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:16.019855 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] PATH_INFO: `/v3/projects/fc932a5ac5c2441ebf01199b3ce4b317` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:16.022103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc932a5ac5c2441ebf01199b3ce4b317)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:16.024579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:16.027490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 922/1826] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:16.107677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc932a5ac5c2441ebf01199b3ce4b317', 'request_id': 'req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.117244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc932a5ac5c2441ebf01199b3ce4b317', 'request_id': 'req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.125446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc932a5ac5c2441ebf01199b3ce4b317', 'request_id': 'req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.139749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] The token cache is being invalidate because project fc932a5ac5c2441ebf01199b3ce4b317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:16.140040 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.141002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.143509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 905/1827] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:15 2021] DELETE /identity/v3/projects/fc932a5ac5c2441ebf01199b3ce4b317 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:16.147353 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d9e0b-2702-4b23-9cc4-9bd4c00cf713 service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:16.159758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d9e0b-2702-4b23-9cc4-9bd4c00cf713 service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:16.229450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:16.230843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:16.231291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:16.231565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] PATH_INFO: `/v3/users/6c5372ad0e0743efaa389d0a5d2b0075` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:16.232818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5372ad0e0743efaa389d0a5d2b0075)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:16.234948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:16.289981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5372ad0e0743efaa389d0a5d2b0075'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.290759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5372ad0e0743efaa389d0a5d2b0075'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.299801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5372ad0e0743efaa389d0a5d2b0075'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.301097 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5372ad0e0743efaa389d0a5d2b0075'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.317844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5372ad0e0743efaa389d0a5d2b0075'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.336296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 923/1828] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:16 2021] DELETE /identity/v3/users/6c5372ad0e0743efaa389d0a5d2b0075 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:16.489253 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:16.491699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:16.515510 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f72b1-5eec-4ac7-b2e9-a9ce92e67af4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:16.624116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:16.625242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:16.626023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:16.626760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] PATH_INFO: `/v3/projects/c0cf2ca0003a4207b4d98012435eed8c` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:16.628572 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0cf2ca0003a4207b4d98012435eed8c)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:16.630677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:16.702637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0cf2ca0003a4207b4d98012435eed8c', 'request_id': 'req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.709699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0cf2ca0003a4207b4d98012435eed8c', 'request_id': 'req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.730145 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0cf2ca0003a4207b4d98012435eed8c', 'request_id': 'req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.747316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:16.748967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:16.750062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] The token cache is being invalidate because project c0cf2ca0003a4207b4d98012435eed8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:16.750391 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.751881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.754527 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 906/1829] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:16 2021] DELETE /identity/v3/projects/c0cf2ca0003a4207b4d98012435eed8c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:16.758791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:16.768029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:16.777709 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234da7e-d4c0-44af-bd07-e6e2e807f443 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:16.864573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffe82a-bc97-48e4-b811-1a6a31fcb4eb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:16.871661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663315b-12e8-4211-8218-99d4688e652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:16.877628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663315b-12e8-4211-8218-99d4688e652a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:16.877906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663315b-12e8-4211-8218-99d4688e652a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:16.878197 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663315b-12e8-4211-8218-99d4688e652a admin admin] PATH_INFO: `/v3/users/48b237b9a7bc41a0be46ab6e456bed85` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:16.884208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663315b-12e8-4211-8218-99d4688e652a admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b237b9a7bc41a0be46ab6e456bed85)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:16.886191 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663315b-12e8-4211-8218-99d4688e652a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:16.895854 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569f13a-4d5d-4a2a-a559-72f7621c674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:16.896763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569f13a-4d5d-4a2a-a559-72f7621c674d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:16.897202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569f13a-4d5d-4a2a-a559-72f7621c674d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:16.897618 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569f13a-4d5d-4a2a-a559-72f7621c674d admin admin] PATH_INFO: `/v3/projects/1b88d9cb502d412f8ffa0ef9f4c70a94` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:16.899049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569f13a-4d5d-4a2a-a559-72f7621c674d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b88d9cb502d412f8ffa0ef9f4c70a94)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:16.901296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569f13a-4d5d-4a2a-a559-72f7621c674d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:16.977795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b663315b-12e8-4211-8218-99d4688e652a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b237b9a7bc41a0be46ab6e456bed85'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.981433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0569f13a-4d5d-4a2a-a559-72f7621c674d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b88d9cb502d412f8ffa0ef9f4c70a94', 'request_id': 'req-0569f13a-4d5d-4a2a-a559-72f7621c674d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.988020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0569f13a-4d5d-4a2a-a559-72f7621c674d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b88d9cb502d412f8ffa0ef9f4c70a94', 'request_id': 'req-0569f13a-4d5d-4a2a-a559-72f7621c674d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.988353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b663315b-12e8-4211-8218-99d4688e652a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b237b9a7bc41a0be46ab6e456bed85'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.989105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b663315b-12e8-4211-8218-99d4688e652a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b237b9a7bc41a0be46ab6e456bed85'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.989741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b663315b-12e8-4211-8218-99d4688e652a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b237b9a7bc41a0be46ab6e456bed85'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:16.997121 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0569f13a-4d5d-4a2a-a559-72f7621c674d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b88d9cb502d412f8ffa0ef9f4c70a94', 'request_id': 'req-0569f13a-4d5d-4a2a-a559-72f7621c674d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:17.012314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b663315b-12e8-4211-8218-99d4688e652a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b237b9a7bc41a0be46ab6e456bed85'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:17.042161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 907/1830] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:16 2021] DELETE /identity/v3/users/48b237b9a7bc41a0be46ab6e456bed85 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:17.042403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0569f13a-4d5d-4a2a-a559-72f7621c674d admin admin] The token cache is being invalidate because project 1b88d9cb502d412f8ffa0ef9f4c70a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:17.042403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0569f13a-4d5d-4a2a-a559-72f7621c674d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:17.043072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0569f13a-4d5d-4a2a-a559-72f7621c674d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:17.045732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 924/1831] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:16 2021] DELETE /identity/v3/projects/1b88d9cb502d412f8ffa0ef9f4c70a94 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:17.059763 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7f17a-a79c-4df1-9743-a967de0e7c07 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:17.060057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7f17a-a79c-4df1-9743-a967de0e7c07 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:17.060337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7f17a-a79c-4df1-9743-a967de0e7c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:17.106621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c9e7f17a-a79c-4df1-9743-a967de0e7c07 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:17.109403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c9e7f17a-a79c-4df1-9743-a967de0e7c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:17.206739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 908/1832] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:17.213386 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b884dc-85eb-49ca-915e-4ba162302b05 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:17.213680 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b884dc-85eb-49ca-915e-4ba162302b05 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:17.214015 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b884dc-85eb-49ca-915e-4ba162302b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:17.245293 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-53b884dc-85eb-49ca-915e-4ba162302b05 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:17.247670 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-53b884dc-85eb-49ca-915e-4ba162302b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:17.262597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 925/1833] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:17.263836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7f17a-a79c-4df1-9743-a967de0e7c07 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:17.274842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7f17a-a79c-4df1-9743-a967de0e7c07 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:17.281418 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb3712-6f94-4392-b779-2a4414a65274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:17.282402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb3712-6f94-4392-b779-2a4414a65274 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:17.282514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb3712-6f94-4392-b779-2a4414a65274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:17.282975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb3712-6f94-4392-b779-2a4414a65274 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:17.284472 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb3712-6f94-4392-b779-2a4414a65274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:17.284472 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb3712-6f94-4392-b779-2a4414a65274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:17.286231 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb3712-6f94-4392-b779-2a4414a65274 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:17.305903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 909/1834] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 01:09:17.311042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b884dc-85eb-49ca-915e-4ba162302b05 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:17.337217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b884dc-85eb-49ca-915e-4ba162302b05 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:17.346296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651ef79-c380-47b8-8482-36f3f573b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:17.347490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651ef79-c380-47b8-8482-36f3f573b7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:17.347490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651ef79-c380-47b8-8482-36f3f573b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:17.347692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651ef79-c380-47b8-8482-36f3f573b7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:17.348239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651ef79-c380-47b8-8482-36f3f573b7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:17.350193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651ef79-c380-47b8-8482-36f3f573b7f0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:17.383330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 926/1835] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:17 2021] POST /identity/v3/projects => generated 361 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:17.383555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb3712-6f94-4392-b779-2a4414a65274 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:17.397340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb3712-6f94-4392-b779-2a4414a65274 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:17.525874 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772d03e-72d0-47b5-940b-2e28fc430840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:17.527742 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772d03e-72d0-47b5-940b-2e28fc430840 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:17.527975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772d03e-72d0-47b5-940b-2e28fc430840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:17.528263 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772d03e-72d0-47b5-940b-2e28fc430840 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:17.528963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772d03e-72d0-47b5-940b-2e28fc430840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:17.532416 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772d03e-72d0-47b5-940b-2e28fc430840 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:17.562547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 910/1836] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:17 2021] POST /identity/v3/users => generated 281 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:17.570648 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651ef79-c380-47b8-8482-36f3f573b7f0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:17.591981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651ef79-c380-47b8-8482-36f3f573b7f0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:17.597027 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772d03e-72d0-47b5-940b-2e28fc430840 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:17.599328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-6772d03e-72d0-47b5-940b-2e28fc430840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:17.600315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871d15-d5f0-4be2-a173-616232188e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:17.601348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871d15-d5f0-4be2-a173-616232188e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:17.601889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871d15-d5f0-4be2-a173-616232188e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:17.602988 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871d15-d5f0-4be2-a173-616232188e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:17.606913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52871d15-d5f0-4be2-a173-616232188e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:17.608593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52871d15-d5f0-4be2-a173-616232188e01 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:17.619594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772d03e-72d0-47b5-940b-2e28fc430840 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:17.627332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 927/1837] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:17 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:09:17.628294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:17.628416 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871d15-d5f0-4be2-a173-616232188e01 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:17.629261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:17.629634 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:17.629988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0 admin admin] PATH_INFO: `/v3/projects/9ad12d9abe1d421d99a06e482e92d77e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:17.646825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad12d9abe1d421d99a06e482e92d77e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:17.649317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871d15-d5f0-4be2-a173-616232188e01 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:17.651453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:17.653843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beedbe7-9b0f-4536-90fb-ee854dfee7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:17.654548 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beedbe7-9b0f-4536-90fb-ee854dfee7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:17.654830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beedbe7-9b0f-4536-90fb-ee854dfee7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:17.655101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beedbe7-9b0f-4536-90fb-ee854dfee7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:17.655853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beedbe7-9b0f-4536-90fb-ee854dfee7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:17.657693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beedbe7-9b0f-4536-90fb-ee854dfee7e3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:17.673472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 928/1838] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:17 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:17.674410 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beedbe7-9b0f-4536-90fb-ee854dfee7e3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:17.689366 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beedbe7-9b0f-4536-90fb-ee854dfee7e3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:17.693660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df52d15-22ef-4b59-96ce-493a0513aa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:17.694750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52d15-22ef-4b59-96ce-493a0513aa7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:17.695140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52d15-22ef-4b59-96ce-493a0513aa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:17.695343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52d15-22ef-4b59-96ce-493a0513aa7b admin admin] PATH_INFO: `/v3/projects/932d651b4c8b4621b2eff34c916c2be8/users/e784dd5f47b5488fbd6b41b77baa9c7b/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:17.711945 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df52d15-22ef-4b59-96ce-493a0513aa7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=932d651b4c8b4621b2eff34c916c2be8, user_id=e784dd5f47b5488fbd6b41b77baa9c7b, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:17.715362 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df52d15-22ef-4b59-96ce-493a0513aa7b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:17.734105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad12d9abe1d421d99a06e482e92d77e', 'request_id': 'req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:17.741408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 929/1839] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:17 2021] PUT /identity/v3/projects/932d651b4c8b4621b2eff34c916c2be8/users/e784dd5f47b5488fbd6b41b77baa9c7b/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:17.741854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad12d9abe1d421d99a06e482e92d77e', 'request_id': 'req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:17.742401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df52d15-22ef-4b59-96ce-493a0513aa7b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:17.749699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0df52d15-22ef-4b59-96ce-493a0513aa7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:17.763078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad12d9abe1d421d99a06e482e92d77e', 'request_id': 'req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:17.781781 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0 admin admin] The token cache is being invalidate because project 9ad12d9abe1d421d99a06e482e92d77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:17.782100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:17.782938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9b9e8af5-ce50-44fa-b957-9b16c5da7ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:17.789055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 911/1840] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:17 2021] DELETE /identity/v3/projects/9ad12d9abe1d421d99a06e482e92d77e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:17.789055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098790c-6b2b-466d-b722-f25d0a2557d4 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:17.789055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098790c-6b2b-466d-b722-f25d0a2557d4 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:17.789055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098790c-6b2b-466d-b722-f25d0a2557d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:17.833370 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e098790c-6b2b-466d-b722-f25d0a2557d4 None None] MFA Rules not processed for user `e784dd5f47b5488fbd6b41b77baa9c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:17.834827 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e098790c-6b2b-466d-b722-f25d0a2557d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:17.883727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df52d15-22ef-4b59-96ce-493a0513aa7b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:17.892529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624043fe-8997-44fe-9de7-65f8cc6055f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:17.894514 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624043fe-8997-44fe-9de7-65f8cc6055f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:17.895150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624043fe-8997-44fe-9de7-65f8cc6055f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:17.895624 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624043fe-8997-44fe-9de7-65f8cc6055f9 admin admin] PATH_INFO: `/v3/users/1cab79223f7a4cfaa698d1f687f0eb10` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:17.899392 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624043fe-8997-44fe-9de7-65f8cc6055f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cab79223f7a4cfaa698d1f687f0eb10)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:17.904861 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624043fe-8997-44fe-9de7-65f8cc6055f9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:17.917287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 912/1841] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:17 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:17.920190 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09772ae-d059-474d-902d-711f3c009905 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:17.921111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09772ae-d059-474d-902d-711f3c009905 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:17.921410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09772ae-d059-474d-902d-711f3c009905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:17.953628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b09772ae-d059-474d-902d-711f3c009905 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:17.955178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b09772ae-d059-474d-902d-711f3c009905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:17.966303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 913/1842] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:17.968213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09772ae-d059-474d-902d-711f3c009905 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:17.969980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b09772ae-d059-474d-902d-711f3c009905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:17.990990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-624043fe-8997-44fe-9de7-65f8cc6055f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cab79223f7a4cfaa698d1f687f0eb10'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:17.991829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-624043fe-8997-44fe-9de7-65f8cc6055f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cab79223f7a4cfaa698d1f687f0eb10'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:18.002806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-624043fe-8997-44fe-9de7-65f8cc6055f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cab79223f7a4cfaa698d1f687f0eb10'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:18.004127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-624043fe-8997-44fe-9de7-65f8cc6055f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cab79223f7a4cfaa698d1f687f0eb10'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:18.019245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-624043fe-8997-44fe-9de7-65f8cc6055f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cab79223f7a4cfaa698d1f687f0eb10'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:18.045013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 930/1843] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:17 2021] DELETE /identity/v3/users/1cab79223f7a4cfaa698d1f687f0eb10 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:18.048272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bf5e2-757b-4c6f-b3f3-89d9756ea5c8 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.048935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bf5e2-757b-4c6f-b3f3-89d9756ea5c8 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.050687 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bf5e2-757b-4c6f-b3f3-89d9756ea5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:18.061622 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09772ae-d059-474d-902d-711f3c009905 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:18.079394 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-828bf5e2-757b-4c6f-b3f3-89d9756ea5c8 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:18.080716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-828bf5e2-757b-4c6f-b3f3-89d9756ea5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:18.141654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e25a2b-3916-4e9b-8a9d-602b6ba0d153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:18.143563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e25a2b-3916-4e9b-8a9d-602b6ba0d153 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.143563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e25a2b-3916-4e9b-8a9d-602b6ba0d153 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.143563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e25a2b-3916-4e9b-8a9d-602b6ba0d153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:18.151540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e4e25a2b-3916-4e9b-8a9d-602b6ba0d153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:18.227459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 931/1844] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:18.228850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00875904-cbbc-437f-9a37-4bf847c865a4 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.229139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00875904-cbbc-437f-9a37-4bf847c865a4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.234837 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00875904-cbbc-437f-9a37-4bf847c865a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:18.251580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e25a2b-3916-4e9b-8a9d-602b6ba0d153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:18.256141 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-00875904-cbbc-437f-9a37-4bf847c865a4 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:18.257841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-00875904-cbbc-437f-9a37-4bf847c865a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:18.259562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e25a2b-3916-4e9b-8a9d-602b6ba0d153 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:18.280186 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 932/1845] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:18.281050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00875904-cbbc-437f-9a37-4bf847c865a4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:18.286727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 914/1846] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:17 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:18.290667 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00875904-cbbc-437f-9a37-4bf847c865a4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:18.304198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e25a2b-3916-4e9b-8a9d-602b6ba0d153 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:18.304409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00243e8-cd0e-4a86-8683-35e5ced77e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:18.305148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00243e8-cd0e-4a86-8683-35e5ced77e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.305383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00243e8-cd0e-4a86-8683-35e5ced77e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.305662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00243e8-cd0e-4a86-8683-35e5ced77e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:18.305866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e4e25a2b-3916-4e9b-8a9d-602b6ba0d153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:18.306649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00243e8-cd0e-4a86-8683-35e5ced77e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:18.306962 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00243e8-cd0e-4a86-8683-35e5ced77e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:18.309165 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00243e8-cd0e-4a86-8683-35e5ced77e56 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:18.322119 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 933/1847] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:09:18.325434 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e25a2b-3916-4e9b-8a9d-602b6ba0d153 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:18.327017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00243e8-cd0e-4a86-8683-35e5ced77e56 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:18.328750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e00243e8-cd0e-4a86-8683-35e5ced77e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:18.331229 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc1d97-85b8-4d56-ab53-b38ee4d9cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:18.332112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc1d97-85b8-4d56-ab53-b38ee4d9cc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.333003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc1d97-85b8-4d56-ab53-b38ee4d9cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.343121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc1d97-85b8-4d56-ab53-b38ee4d9cc9a admin admin] PATH_INFO: `/v3/users/e784dd5f47b5488fbd6b41b77baa9c7b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:18.344793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc1d97-85b8-4d56-ab53-b38ee4d9cc9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e784dd5f47b5488fbd6b41b77baa9c7b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:18.347198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc1d97-85b8-4d56-ab53-b38ee4d9cc9a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:18.410885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00243e8-cd0e-4a86-8683-35e5ced77e56 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:18.419524 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2e81-65b9-484b-838b-430f286fd9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:18.420193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2e81-65b9-484b-838b-430f286fd9ac service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.420477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2e81-65b9-484b-838b-430f286fd9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.420753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2e81-65b9-484b-838b-430f286fd9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:18.423172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-25dc1d97-85b8-4d56-ab53-b38ee4d9cc9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e784dd5f47b5488fbd6b41b77baa9c7b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:18.434729 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-25dc1d97-85b8-4d56-ab53-b38ee4d9cc9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e784dd5f47b5488fbd6b41b77baa9c7b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:18.437911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-25dc1d97-85b8-4d56-ab53-b38ee4d9cc9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e784dd5f47b5488fbd6b41b77baa9c7b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:18.437911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-25dc1d97-85b8-4d56-ab53-b38ee4d9cc9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e784dd5f47b5488fbd6b41b77baa9c7b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:18.440728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce2e81-65b9-484b-838b-430f286fd9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:18.442437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce2e81-65b9-484b-838b-430f286fd9ac service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:18.453096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-25dc1d97-85b8-4d56-ab53-b38ee4d9cc9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e784dd5f47b5488fbd6b41b77baa9c7b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:18.455027 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 934/1848] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:18.456106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2e81-65b9-484b-838b-430f286fd9ac service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:18.477612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2e81-65b9-484b-838b-430f286fd9ac service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:18.478582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 915/1849] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:18 2021] DELETE /identity/v3/users/e784dd5f47b5488fbd6b41b77baa9c7b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:18.483199 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eaa7b-8b12-46a3-8564-6080c7af507f None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.483559 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eaa7b-8b12-46a3-8564-6080c7af507f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.483910 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eaa7b-8b12-46a3-8564-6080c7af507f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:18.512635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-642eaa7b-8b12-46a3-8564-6080c7af507f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:18.514854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-642eaa7b-8b12-46a3-8564-6080c7af507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:18.560405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b46755-4797-4b26-b2ad-2fb20560c41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:18.561302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b46755-4797-4b26-b2ad-2fb20560c41a admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.561685 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b46755-4797-4b26-b2ad-2fb20560c41a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.561971 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b46755-4797-4b26-b2ad-2fb20560c41a admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:18.563253 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b46755-4797-4b26-b2ad-2fb20560c41a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:18.567063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b46755-4797-4b26-b2ad-2fb20560c41a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:18.609073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 935/1850] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:18 2021] POST /identity/v3/projects => generated 409 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:18.615917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b46755-4797-4b26-b2ad-2fb20560c41a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:18.620035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-80b46755-4797-4b26-b2ad-2fb20560c41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:18.648161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 916/1851] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:18.658974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eaa7b-8b12-46a3-8564-6080c7af507f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:18.662079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-642eaa7b-8b12-46a3-8564-6080c7af507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:18.738215 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eaa7b-8b12-46a3-8564-6080c7af507f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:18.797538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b46755-4797-4b26-b2ad-2fb20560c41a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:18.809659 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f477c7-fd2c-452f-b79e-da8b15e137bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:18.810890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f477c7-fd2c-452f-b79e-da8b15e137bb admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.811384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f477c7-fd2c-452f-b79e-da8b15e137bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.812657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f477c7-fd2c-452f-b79e-da8b15e137bb admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:18.813473 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f477c7-fd2c-452f-b79e-da8b15e137bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:18.816648 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f477c7-fd2c-452f-b79e-da8b15e137bb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:18.824551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1019a2-b135-401c-8dc2-23f54f39d607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:18.826099 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1019a2-b135-401c-8dc2-23f54f39d607 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.827692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1019a2-b135-401c-8dc2-23f54f39d607 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.828128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1019a2-b135-401c-8dc2-23f54f39d607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:18.861031 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 936/1852] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:18 2021] POST /identity/v3/users => generated 305 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:18.865869 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f477c7-fd2c-452f-b79e-da8b15e137bb admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:18.868044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1019a2-b135-401c-8dc2-23f54f39d607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:18.872025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1019a2-b135-401c-8dc2-23f54f39d607 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:18.879752 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f477c7-fd2c-452f-b79e-da8b15e137bb admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:18.885492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 917/1853] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:09:18.886906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f7b32-c04b-43e2-bf30-351382f928bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:18.887700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7b32-c04b-43e2-bf30-351382f928bf admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.888059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7b32-c04b-43e2-bf30-351382f928bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.888875 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7b32-c04b-43e2-bf30-351382f928bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:18.889643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f7b32-c04b-43e2-bf30-351382f928bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:18.891334 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f7b32-c04b-43e2-bf30-351382f928bf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:18.906552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 937/1854] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:18 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:18.909623 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1019a2-b135-401c-8dc2-23f54f39d607 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:18.920135 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1019a2-b135-401c-8dc2-23f54f39d607 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:18.925530 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47906eb3-2698-4f23-a5f1-7f8948f6e107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:18.926281 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47906eb3-2698-4f23-a5f1-7f8948f6e107 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.926720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47906eb3-2698-4f23-a5f1-7f8948f6e107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.932203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47906eb3-2698-4f23-a5f1-7f8948f6e107 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:18.937465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47906eb3-2698-4f23-a5f1-7f8948f6e107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:18.939402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47906eb3-2698-4f23-a5f1-7f8948f6e107 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:18.969339 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 918/1855] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:18 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:18.970459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f7b32-c04b-43e2-bf30-351382f928bf admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:18.982804 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f7b32-c04b-43e2-bf30-351382f928bf admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:18.988129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9747ae4-e033-4435-9de5-9de42784c6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:18.989219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9747ae4-e033-4435-9de5-9de42784c6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:18.989505 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9747ae4-e033-4435-9de5-9de42784c6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:18.989781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9747ae4-e033-4435-9de5-9de42784c6d2 admin admin] PATH_INFO: `/v3/projects/9c2b3a985fe046f6b84dbbf2a5bd4c64/users/8c8a3f588937423e80d8fdc24afb238a/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.008265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9747ae4-e033-4435-9de5-9de42784c6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2b3a985fe046f6b84dbbf2a5bd4c64, user_id=8c8a3f588937423e80d8fdc24afb238a, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:19.012207 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9747ae4-e033-4435-9de5-9de42784c6d2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:19.034626 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 938/1856] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:18 2021] PUT /identity/v3/projects/9c2b3a985fe046f6b84dbbf2a5bd4c64/users/8c8a3f588937423e80d8fdc24afb238a/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:19.038241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4518c91-eec4-48be-9c99-12b39f0f354a None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.038582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4518c91-eec4-48be-9c99-12b39f0f354a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.038865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4518c91-eec4-48be-9c99-12b39f0f354a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.085872 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-a4518c91-eec4-48be-9c99-12b39f0f354a None None] MFA Rules not processed for user `8c8a3f588937423e80d8fdc24afb238a`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:19.087284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a4518c91-eec4-48be-9c99-12b39f0f354a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:19.119683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9747ae4-e033-4435-9de5-9de42784c6d2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:19.122166 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b9747ae4-e033-4435-9de5-9de42784c6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:19.163076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 919/1857] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:19 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:19.168880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4518c91-eec4-48be-9c99-12b39f0f354a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:19.226321 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9747ae4-e033-4435-9de5-9de42784c6d2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:19.231944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:19.232805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.233910 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.234192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] PATH_INFO: `/v3/projects/9de507ba72884b839715367c90e1fea5` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.235472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de507ba72884b839715367c90e1fea5)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:19.237440 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:19.247086 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4518c91-eec4-48be-9c99-12b39f0f354a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:19.253777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2ea12-8a60-445c-bb20-80b4ef9a4ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:19.254506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2ea12-8a60-445c-bb20-80b4ef9a4ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.254791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2ea12-8a60-445c-bb20-80b4ef9a4ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.255065 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2ea12-8a60-445c-bb20-80b4ef9a4ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.255905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2ea12-8a60-445c-bb20-80b4ef9a4ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:19.257840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2ea12-8a60-445c-bb20-80b4ef9a4ab8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:19.295359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 920/1858] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:19 2021] POST /identity/v3/projects => generated 409 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:19.296738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2ea12-8a60-445c-bb20-80b4ef9a4ab8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:19.299924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-cff2ea12-8a60-445c-bb20-80b4ef9a4ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:19.300301 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de507ba72884b839715367c90e1fea5', 'request_id': 'req-b320ffcd-2ccb-4749-b78f-d03577d93ec0'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.308497 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de507ba72884b839715367c90e1fea5', 'request_id': 'req-b320ffcd-2ccb-4749-b78f-d03577d93ec0'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.317799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de507ba72884b839715367c90e1fea5', 'request_id': 'req-b320ffcd-2ccb-4749-b78f-d03577d93ec0'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.334143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] The token cache is being invalidate because project 9de507ba72884b839715367c90e1fea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:19.334481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.335152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.337256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 939/1859] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:19 2021] DELETE /identity/v3/projects/9de507ba72884b839715367c90e1fea5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:19.337956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:19.339822 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:19.379705 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2ea12-8a60-445c-bb20-80b4ef9a4ab8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:19.385345 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:19.386594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.386889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.387337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] PATH_INFO: `/v3/projects/932d651b4c8b4621b2eff34c916c2be8` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.388594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=932d651b4c8b4621b2eff34c916c2be8)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:19.390564 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:19.412383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320ffcd-2ccb-4749-b78f-d03577d93ec0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:19.418917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7377d81-4344-4ea0-84ee-c6347614d34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:19.419560 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7377d81-4344-4ea0-84ee-c6347614d34d admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.419949 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7377d81-4344-4ea0-84ee-c6347614d34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.420227 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7377d81-4344-4ea0-84ee-c6347614d34d admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.420938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7377d81-4344-4ea0-84ee-c6347614d34d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:19.422875 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7377d81-4344-4ea0-84ee-c6347614d34d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:19.446454 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 940/1860] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:19 2021] POST /identity/v3/users => generated 311 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:19.446454 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7377d81-4344-4ea0-84ee-c6347614d34d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:19.447986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e7377d81-4344-4ea0-84ee-c6347614d34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:19.450116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932d651b4c8b4621b2eff34c916c2be8', 'request_id': 'req-0fe03c80-90a2-43bc-98b6-40a77003bd2b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.455631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932d651b4c8b4621b2eff34c916c2be8', 'request_id': 'req-0fe03c80-90a2-43bc-98b6-40a77003bd2b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.462731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7377d81-4344-4ea0-84ee-c6347614d34d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:19.469967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932d651b4c8b4621b2eff34c916c2be8', 'request_id': 'req-0fe03c80-90a2-43bc-98b6-40a77003bd2b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.484279 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] The token cache is being invalidate because project 932d651b4c8b4621b2eff34c916c2be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:19.484853 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.485566 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.487227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 921/1861] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:19 2021] DELETE /identity/v3/projects/932d651b4c8b4621b2eff34c916c2be8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:19.488053 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:19.492289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:19.527673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08953016-2fd5-42b1-9d93-b41277928eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:19.528549 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08953016-2fd5-42b1-9d93-b41277928eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.528832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08953016-2fd5-42b1-9d93-b41277928eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.529112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08953016-2fd5-42b1-9d93-b41277928eac admin admin] PATH_INFO: `/v3/users/36aa024e19e34af38dae09608527b5de` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.530356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08953016-2fd5-42b1-9d93-b41277928eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=36aa024e19e34af38dae09608527b5de)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:19.532358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08953016-2fd5-42b1-9d93-b41277928eac admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:19.567739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe03c80-90a2-43bc-98b6-40a77003bd2b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:19.577297 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646caa41-46e0-4066-8fff-6f2c4d018f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:19.578012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646caa41-46e0-4066-8fff-6f2c4d018f4f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.578344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646caa41-46e0-4066-8fff-6f2c4d018f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.578654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646caa41-46e0-4066-8fff-6f2c4d018f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.579442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646caa41-46e0-4066-8fff-6f2c4d018f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:19.581080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646caa41-46e0-4066-8fff-6f2c4d018f4f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:19.597283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-08953016-2fd5-42b1-9d93-b41277928eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36aa024e19e34af38dae09608527b5de'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.599512 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-08953016-2fd5-42b1-9d93-b41277928eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36aa024e19e34af38dae09608527b5de'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.610536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 922/1862] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:19 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:19.610536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d10b9f-fca8-42a0-a37d-3cb15a607296 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.610536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d10b9f-fca8-42a0-a37d-3cb15a607296 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.610536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d10b9f-fca8-42a0-a37d-3cb15a607296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.613796 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-08953016-2fd5-42b1-9d93-b41277928eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36aa024e19e34af38dae09608527b5de'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.615860 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-08953016-2fd5-42b1-9d93-b41277928eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36aa024e19e34af38dae09608527b5de'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.629614 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c7d10b9f-fca8-42a0-a37d-3cb15a607296 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:19.630866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c7d10b9f-fca8-42a0-a37d-3cb15a607296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:19.631246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-08953016-2fd5-42b1-9d93-b41277928eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36aa024e19e34af38dae09608527b5de'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:19.640741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 923/1863] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:19.641458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d10b9f-fca8-42a0-a37d-3cb15a607296 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:19.647589 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 941/1864] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:19 2021] DELETE /identity/v3/users/36aa024e19e34af38dae09608527b5de => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:19.648976 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ce60b-a236-4ba0-9ba8-a42b5b6105a7 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.649265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ce60b-a236-4ba0-9ba8-a42b5b6105a7 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.649539 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ce60b-a236-4ba0-9ba8-a42b5b6105a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.652279 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c7d10b9f-fca8-42a0-a37d-3cb15a607296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:19.669961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d10b9f-fca8-42a0-a37d-3cb15a607296 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:19.680585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-5e7ce60b-a236-4ba0-9ba8-a42b5b6105a7 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:19.681967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5e7ce60b-a236-4ba0-9ba8-a42b5b6105a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:19.740534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49552773-b94a-4c99-9ef2-181ec1bf397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:19.742020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49552773-b94a-4c99-9ef2-181ec1bf397c admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.742445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49552773-b94a-4c99-9ef2-181ec1bf397c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.742800 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49552773-b94a-4c99-9ef2-181ec1bf397c admin admin] PATH_INFO: `/v3/projects/a635295eb2c4470494fef4bd9cd9ded6/users/37d264b24c39474e99704fdd8567091f/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.761694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 942/1865] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:19.762876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49552773-b94a-4c99-9ef2-181ec1bf397c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a635295eb2c4470494fef4bd9cd9ded6, user_id=37d264b24c39474e99704fdd8567091f, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:19.766441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49552773-b94a-4c99-9ef2-181ec1bf397c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:19.767071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ce60b-a236-4ba0-9ba8-a42b5b6105a7 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:19.779435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ce60b-a236-4ba0-9ba8-a42b5b6105a7 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:19.789922 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 924/1866] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:19 2021] PUT /identity/v3/projects/a635295eb2c4470494fef4bd9cd9ded6/users/37d264b24c39474e99704fdd8567091f/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:19.791544 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49552773-b94a-4c99-9ef2-181ec1bf397c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:19.905654 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b2e64-18e1-447d-88bd-fd0075d84920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:19.906586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b2e64-18e1-447d-88bd-fd0075d84920 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.907515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b2e64-18e1-447d-88bd-fd0075d84920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.908078 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b2e64-18e1-447d-88bd-fd0075d84920 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.908980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b2e64-18e1-447d-88bd-fd0075d84920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:19.909446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b2e64-18e1-447d-88bd-fd0075d84920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:19.911286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b2e64-18e1-447d-88bd-fd0075d84920 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:19.911454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49552773-b94a-4c99-9ef2-181ec1bf397c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:19.917881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc7e4a-a70c-46b5-b3a1-701013b090fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:19.919226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc7e4a-a70c-46b5-b3a1-701013b090fe admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.919517 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc7e4a-a70c-46b5-b3a1-701013b090fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.919801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc7e4a-a70c-46b5-b3a1-701013b090fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.930242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 943/1867] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:09:19.936114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc7e4a-a70c-46b5-b3a1-701013b090fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:19.936908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b2e64-18e1-447d-88bd-fd0075d84920 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:19.943221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc7e4a-a70c-46b5-b3a1-701013b090fe admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:19.955899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b2e64-18e1-447d-88bd-fd0075d84920 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:19.974409 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 925/1868] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:19 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:19.976736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc7e4a-a70c-46b5-b3a1-701013b090fe admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:19.977547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2256b6-7899-4d37-9b9b-7da376ecfbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:19.978763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2256b6-7899-4d37-9b9b-7da376ecfbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:19.979153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2256b6-7899-4d37-9b9b-7da376ecfbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:19.979576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2256b6-7899-4d37-9b9b-7da376ecfbe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:19.980449 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2256b6-7899-4d37-9b9b-7da376ecfbe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:19.982786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2256b6-7899-4d37-9b9b-7da376ecfbe2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:20.001052 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc7e4a-a70c-46b5-b3a1-701013b090fe admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:20.020070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1561f-1b2d-4bba-a9cb-492bc795b792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:20.020994 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1561f-1b2d-4bba-a9cb-492bc795b792 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:20.021273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1561f-1b2d-4bba-a9cb-492bc795b792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:20.021628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1561f-1b2d-4bba-a9cb-492bc795b792 admin admin] PATH_INFO: `/v3/projects/a635295eb2c4470494fef4bd9cd9ded6/users/37d264b24c39474e99704fdd8567091f/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:20.029131 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1561f-1b2d-4bba-a9cb-492bc795b792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a635295eb2c4470494fef4bd9cd9ded6, user_id=37d264b24c39474e99704fdd8567091f, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:20.031902 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1561f-1b2d-4bba-a9cb-492bc795b792 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:20.038610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 944/1869] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:19 2021] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:20.039943 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2256b6-7899-4d37-9b9b-7da376ecfbe2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:20.062104 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 926/1870] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:19 2021] PUT /identity/v3/projects/a635295eb2c4470494fef4bd9cd9ded6/users/37d264b24c39474e99704fdd8567091f/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:20.070714 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1561f-1b2d-4bba-a9cb-492bc795b792 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:20.074658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a8b1561f-1b2d-4bba-a9cb-492bc795b792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:20.257642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2256b6-7899-4d37-9b9b-7da376ecfbe2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:20.258654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1561f-1b2d-4bba-a9cb-492bc795b792 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:20.280867 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83de317-d9c7-44fa-b601-b9a28a50221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:20.282437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83de317-d9c7-44fa-b601-b9a28a50221e admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:20.283343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83de317-d9c7-44fa-b601-b9a28a50221e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:20.283602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83de317-d9c7-44fa-b601-b9a28a50221e admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:20.284348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:20.286171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:20.286341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83de317-d9c7-44fa-b601-b9a28a50221e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:20.287744 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:20.288334 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83de317-d9c7-44fa-b601-b9a28a50221e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:20.288813 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] PATH_INFO: `/v3/projects/3156dfc6020c48a199c865b4c06f5f13` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:20.294134 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3156dfc6020c48a199c865b4c06f5f13)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:20.299311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:20.319013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 945/1871] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:20 2021] POST /identity/v3/users => generated 288 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:20.323770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed45a7a-96a7-46fa-bf3e-ecc80e349b06 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:20.324275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed45a7a-96a7-46fa-bf3e-ecc80e349b06 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:20.324699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed45a7a-96a7-46fa-bf3e-ecc80e349b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:20.358016 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-5ed45a7a-96a7-46fa-bf3e-ecc80e349b06 None None] MFA Rules not processed for user `37d264b24c39474e99704fdd8567091f`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:20.359403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5ed45a7a-96a7-46fa-bf3e-ecc80e349b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:20.373235 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3156dfc6020c48a199c865b4c06f5f13', 'request_id': 'req-d4728f9b-a0ae-405b-b41c-522b4a33654b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:20.383235 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3156dfc6020c48a199c865b4c06f5f13', 'request_id': 'req-d4728f9b-a0ae-405b-b41c-522b4a33654b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:20.391661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3156dfc6020c48a199c865b4c06f5f13', 'request_id': 'req-d4728f9b-a0ae-405b-b41c-522b4a33654b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:20.407590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] The token cache is being invalidate because project 3156dfc6020c48a199c865b4c06f5f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:20.408136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:20.409069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:20.410763 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 927/1872] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:20 2021] DELETE /identity/v3/projects/3156dfc6020c48a199c865b4c06f5f13 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:20.413675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:20.413675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:20.451934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 946/1873] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:20 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:20.452711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed45a7a-96a7-46fa-bf3e-ecc80e349b06 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:20.464925 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5ed45a7a-96a7-46fa-bf3e-ecc80e349b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:20.494923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4728f9b-a0ae-405b-b41c-522b4a33654b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:20.502089 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd90be-3862-4f9f-a52e-e20c0c434d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:20.502808 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd90be-3862-4f9f-a52e-e20c0c434d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:20.503076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd90be-3862-4f9f-a52e-e20c0c434d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:20.503354 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd90be-3862-4f9f-a52e-e20c0c434d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:20.504101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd90be-3862-4f9f-a52e-e20c0c434d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:20.505719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd90be-3862-4f9f-a52e-e20c0c434d5f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:20.518306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 928/1874] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:20 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:20.519309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd90be-3862-4f9f-a52e-e20c0c434d5f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:20.521133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-39bd90be-3862-4f9f-a52e-e20c0c434d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:20.545971 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed45a7a-96a7-46fa-bf3e-ecc80e349b06 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:20.551217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:20.552105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:20.552384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:20.552655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] PATH_INFO: `/v3/users/6015cdffac6846bd9e8c683c2699e4c8` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:20.553915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6015cdffac6846bd9e8c683c2699e4c8)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:20.556102 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:20.594806 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd90be-3862-4f9f-a52e-e20c0c434d5f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:20.598977 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24788b-7896-429d-ac58-f5b204d8f801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:20.599620 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24788b-7896-429d-ac58-f5b204d8f801 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:20.599898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24788b-7896-429d-ac58-f5b204d8f801 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:20.600223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24788b-7896-429d-ac58-f5b204d8f801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:20.611349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24788b-7896-429d-ac58-f5b204d8f801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:20.612792 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6015cdffac6846bd9e8c683c2699e4c8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:20.613454 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6015cdffac6846bd9e8c683c2699e4c8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:20.613586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24788b-7896-429d-ac58-f5b204d8f801 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:20.621049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6015cdffac6846bd9e8c683c2699e4c8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:20.622207 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6015cdffac6846bd9e8c683c2699e4c8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:20.630076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 929/1875] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:20 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:20.630969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24788b-7896-429d-ac58-f5b204d8f801 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:20.635249 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6015cdffac6846bd9e8c683c2699e4c8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:20.644978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24788b-7896-429d-ac58-f5b204d8f801 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:20.650446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5885a82-a28b-4473-8c4b-1ae6512d13fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:20.651268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5885a82-a28b-4473-8c4b-1ae6512d13fc admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:20.652524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5885a82-a28b-4473-8c4b-1ae6512d13fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:20.652960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5885a82-a28b-4473-8c4b-1ae6512d13fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:20.653058 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 947/1876] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:20 2021] DELETE /identity/v3/users/6015cdffac6846bd9e8c683c2699e4c8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:20.654161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5885a82-a28b-4473-8c4b-1ae6512d13fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:20.655970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5885a82-a28b-4473-8c4b-1ae6512d13fc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:20.671276 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 930/1877] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:20 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:20.673241 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:20.679879 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:20.752098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826aabf-7f9c-4ebb-acf7-0268b404994b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:20.757471 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48cd4f-0573-4d97-9fb2-f02adb0424bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:20.758774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48cd4f-0573-4d97-9fb2-f02adb0424bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:20.759136 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48cd4f-0573-4d97-9fb2-f02adb0424bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:20.759554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48cd4f-0573-4d97-9fb2-f02adb0424bb admin admin] PATH_INFO: `/v3/projects/c0d9c4dfbc1f409d8017dcdc2e770a74/users/3f12b2d45ed14b6bb2ea0c40420a4f8c/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:20.777545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48cd4f-0573-4d97-9fb2-f02adb0424bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d9c4dfbc1f409d8017dcdc2e770a74, user_id=3f12b2d45ed14b6bb2ea0c40420a4f8c, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:20.780617 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48cd4f-0573-4d97-9fb2-f02adb0424bb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:20.802627 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 948/1878] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:20 2021] PUT /identity/v3/projects/c0d9c4dfbc1f409d8017dcdc2e770a74/users/3f12b2d45ed14b6bb2ea0c40420a4f8c/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:20.810552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5885a82-a28b-4473-8c4b-1ae6512d13fc admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:20.812615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f5885a82-a28b-4473-8c4b-1ae6512d13fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:20.814124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27e3be-7e7f-4de8-bd4f-41cb430a4a37 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:20.814558 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27e3be-7e7f-4de8-bd4f-41cb430a4a37 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:20.814726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27e3be-7e7f-4de8-bd4f-41cb430a4a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:20.834618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5885a82-a28b-4473-8c4b-1ae6512d13fc admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:20.844733 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-cb27e3be-7e7f-4de8-bd4f-41cb430a4a37 None None] MFA Rules not processed for user `3f12b2d45ed14b6bb2ea0c40420a4f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:20.846196 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cb27e3be-7e7f-4de8-bd4f-41cb430a4a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:20.893835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e732a07-8aaf-4427-8c3e-9d5fec853499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:20.894527 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e732a07-8aaf-4427-8c3e-9d5fec853499 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:20.894811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e732a07-8aaf-4427-8c3e-9d5fec853499 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:20.895195 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e732a07-8aaf-4427-8c3e-9d5fec853499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:20.897454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8e732a07-8aaf-4427-8c3e-9d5fec853499 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:20.922518 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 949/1879] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:20 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:20.923993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27e3be-7e7f-4de8-bd4f-41cb430a4a37 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:20.964591 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e732a07-8aaf-4427-8c3e-9d5fec853499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:20.966022 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e732a07-8aaf-4427-8c3e-9d5fec853499 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:20.976743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 931/1880] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:20 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:20.976892 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e732a07-8aaf-4427-8c3e-9d5fec853499 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:20.978142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8e732a07-8aaf-4427-8c3e-9d5fec853499 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:20.999647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27e3be-7e7f-4de8-bd4f-41cb430a4a37 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.005076 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c444c4-c531-439b-9bd2-417214ea589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.005747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c444c4-c531-439b-9bd2-417214ea589c admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.006034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c444c4-c531-439b-9bd2-417214ea589c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.006318 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c444c4-c531-439b-9bd2-417214ea589c admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.007116 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c444c4-c531-439b-9bd2-417214ea589c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.009102 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c444c4-c531-439b-9bd2-417214ea589c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.036921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 950/1881] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:20 2021] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:21.041332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c444c4-c531-439b-9bd2-417214ea589c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:21.070610 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e732a07-8aaf-4427-8c3e-9d5fec853499 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.107287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c444c4-c531-439b-9bd2-417214ea589c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.112897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc095b-0e53-425d-a144-3bfcfa6f4abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.113670 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc095b-0e53-425d-a144-3bfcfa6f4abd admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.113958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc095b-0e53-425d-a144-3bfcfa6f4abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.114234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc095b-0e53-425d-a144-3bfcfa6f4abd admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.115000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc095b-0e53-425d-a144-3bfcfa6f4abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.117989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc095b-0e53-425d-a144-3bfcfa6f4abd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.144409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 951/1882] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:21 2021] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:21.144595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4c926-bb17-4741-9304-44c51a14b0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.144595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4c926-bb17-4741-9304-44c51a14b0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.144595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4c926-bb17-4741-9304-44c51a14b0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.144842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4c926-bb17-4741-9304-44c51a14b0cb admin admin] PATH_INFO: `/v3/projects/0d95d2ac8e5b4f16a069681e3855beff` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.145691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc095b-0e53-425d-a144-3bfcfa6f4abd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:21.146298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4c926-bb17-4741-9304-44c51a14b0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d95d2ac8e5b4f16a069681e3855beff)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.148410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4c926-bb17-4741-9304-44c51a14b0cb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.155935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc095b-0e53-425d-a144-3bfcfa6f4abd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.160603 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c6916-f8c6-4231-b3ac-a2aa0170dde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.161264 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c6916-f8c6-4231-b3ac-a2aa0170dde5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.161552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c6916-f8c6-4231-b3ac-a2aa0170dde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.161827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c6916-f8c6-4231-b3ac-a2aa0170dde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.162619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c6916-f8c6-4231-b3ac-a2aa0170dde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.164304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c6916-f8c6-4231-b3ac-a2aa0170dde5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.179075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 952/1883] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:21 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:21.180086 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c6916-f8c6-4231-b3ac-a2aa0170dde5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:21.191242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c6916-f8c6-4231-b3ac-a2aa0170dde5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.210035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-73d4c926-bb17-4741-9304-44c51a14b0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d95d2ac8e5b4f16a069681e3855beff', 'request_id': 'req-73d4c926-bb17-4741-9304-44c51a14b0cb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:21.221962 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-73d4c926-bb17-4741-9304-44c51a14b0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d95d2ac8e5b4f16a069681e3855beff', 'request_id': 'req-73d4c926-bb17-4741-9304-44c51a14b0cb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:21.230577 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-73d4c926-bb17-4741-9304-44c51a14b0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d95d2ac8e5b4f16a069681e3855beff', 'request_id': 'req-73d4c926-bb17-4741-9304-44c51a14b0cb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:21.261961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-73d4c926-bb17-4741-9304-44c51a14b0cb admin admin] The token cache is being invalidate because project 0d95d2ac8e5b4f16a069681e3855beff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:21.262270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-73d4c926-bb17-4741-9304-44c51a14b0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:21.270557 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-73d4c926-bb17-4741-9304-44c51a14b0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:21.272396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 932/1884] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:20 2021] DELETE /identity/v3/projects/0d95d2ac8e5b4f16a069681e3855beff => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:21.274545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6550-bf76-4efd-96b2-598c702f9f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.275481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6550-bf76-4efd-96b2-598c702f9f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.275767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6550-bf76-4efd-96b2-598c702f9f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.276041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6550-bf76-4efd-96b2-598c702f9f3e admin admin] PATH_INFO: `/v3/projects/0d01ddda49da48e9aed4dee80da1243f/users/f983edca215049998e64f5e0d4d9e4b6/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.281074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c63ac-5a8b-4d61-a5d0-7e309b3c0063 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.281310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c63ac-5a8b-4d61-a5d0-7e309b3c0063 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.281591 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c63ac-5a8b-4d61-a5d0-7e309b3c0063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.296674 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c6550-bf76-4efd-96b2-598c702f9f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d01ddda49da48e9aed4dee80da1243f, user_id=f983edca215049998e64f5e0d4d9e4b6, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.299637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c6550-bf76-4efd-96b2-598c702f9f3e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.306952 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-9c8c63ac-5a8b-4d61-a5d0-7e309b3c0063 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:21.308671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9c8c63ac-5a8b-4d61-a5d0-7e309b3c0063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:21.331072 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 933/1885] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:21.340407 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cfa69-b252-47ed-b3a5-a36e989955d6 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.340896 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cfa69-b252-47ed-b3a5-a36e989955d6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.341339 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cfa69-b252-47ed-b3a5-a36e989955d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.342958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 953/1886] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:21 2021] PUT /identity/v3/projects/0d01ddda49da48e9aed4dee80da1243f/users/f983edca215049998e64f5e0d4d9e4b6/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:21.347783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6550-bf76-4efd-96b2-598c702f9f3e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:21.349533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-328c6550-bf76-4efd-96b2-598c702f9f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:21.363301 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-917cfa69-b252-47ed-b3a5-a36e989955d6 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:21.364509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-917cfa69-b252-47ed-b3a5-a36e989955d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:21.418066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6550-bf76-4efd-96b2-598c702f9f3e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.422609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aba570-0420-490b-9e68-446760ca51db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.423271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aba570-0420-490b-9e68-446760ca51db admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.423551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aba570-0420-490b-9e68-446760ca51db admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.423828 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aba570-0420-490b-9e68-446760ca51db admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.424575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aba570-0420-490b-9e68-446760ca51db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.425233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 934/1887] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:21.426287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aba570-0420-490b-9e68-446760ca51db admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.429512 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cfa69-b252-47ed-b3a5-a36e989955d6 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:21.437386 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 954/1888] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:21 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:21.439025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cfa69-b252-47ed-b3a5-a36e989955d6 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.441480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aba570-0420-490b-9e68-446760ca51db admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:21.443966 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebae003-dde7-46e8-bcf5-ef320630b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.444594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebae003-dde7-46e8-bcf5-ef320630b30b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.444883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebae003-dde7-46e8-bcf5-ef320630b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.445164 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebae003-dde7-46e8-bcf5-ef320630b30b admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.445903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebae003-dde7-46e8-bcf5-ef320630b30b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:21.446213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebae003-dde7-46e8-bcf5-ef320630b30b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.447860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebae003-dde7-46e8-bcf5-ef320630b30b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.451992 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aba570-0420-490b-9e68-446760ca51db admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.456591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa77763-acea-43e2-bfd9-7f3ce5def1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.457453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa77763-acea-43e2-bfd9-7f3ce5def1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.457751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa77763-acea-43e2-bfd9-7f3ce5def1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.458006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa77763-acea-43e2-bfd9-7f3ce5def1a1 admin admin] PATH_INFO: `/v3/projects/0d01ddda49da48e9aed4dee80da1243f/users/f983edca215049998e64f5e0d4d9e4b6/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.460133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa77763-acea-43e2-bfd9-7f3ce5def1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d01ddda49da48e9aed4dee80da1243f, user_id=f983edca215049998e64f5e0d4d9e4b6, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.463837 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 935/1889] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 01:09:21.463972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa77763-acea-43e2-bfd9-7f3ce5def1a1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.464738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebae003-dde7-46e8-bcf5-ef320630b30b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:21.473990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 955/1890] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:21 2021] PUT /identity/v3/projects/0d01ddda49da48e9aed4dee80da1243f/users/f983edca215049998e64f5e0d4d9e4b6/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:21.475007 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebae003-dde7-46e8-bcf5-ef320630b30b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.484205 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bfbe1-665c-4cf9-8f91-75b9dd3d885f None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.485022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bfbe1-665c-4cf9-8f91-75b9dd3d885f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.485418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bfbe1-665c-4cf9-8f91-75b9dd3d885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.515740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-203bfbe1-665c-4cf9-8f91-75b9dd3d885f None None] MFA Rules not processed for user `f983edca215049998e64f5e0d4d9e4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:21.517111 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-203bfbe1-665c-4cf9-8f91-75b9dd3d885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:21.541195 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0bc25-5f3d-4f31-a50d-f9945f3e0819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.541904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0bc25-5f3d-4f31-a50d-f9945f3e0819 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.542397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0bc25-5f3d-4f31-a50d-f9945f3e0819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.543436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0bc25-5f3d-4f31-a50d-f9945f3e0819 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.544173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0bc25-5f3d-4f31-a50d-f9945f3e0819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.546157 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0bc25-5f3d-4f31-a50d-f9945f3e0819 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.579500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 936/1891] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:21 2021] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:21.583537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0bc25-5f3d-4f31-a50d-f9945f3e0819 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:21.606983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 956/1892] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:21 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:21.617346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bfbe1-665c-4cf9-8f91-75b9dd3d885f None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:21.618782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-203bfbe1-665c-4cf9-8f91-75b9dd3d885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:21.653919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0bc25-5f3d-4f31-a50d-f9945f3e0819 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.658815 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8612579-6a99-45ca-9c38-7d55c622f29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.659650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8612579-6a99-45ca-9c38-7d55c622f29d admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.659781 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8612579-6a99-45ca-9c38-7d55c622f29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.660064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8612579-6a99-45ca-9c38-7d55c622f29d admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.660776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8612579-6a99-45ca-9c38-7d55c622f29d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.663222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8612579-6a99-45ca-9c38-7d55c622f29d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.685499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 937/1893] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:21 2021] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:21.689863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8612579-6a99-45ca-9c38-7d55c622f29d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:21.692984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bfbe1-665c-4cf9-8f91-75b9dd3d885f None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.700354 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8612579-6a99-45ca-9c38-7d55c622f29d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.705375 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945e1b4-ab24-44fc-a390-37fffc6cb459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.706027 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945e1b4-ab24-44fc-a390-37fffc6cb459 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.706302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945e1b4-ab24-44fc-a390-37fffc6cb459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.706651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945e1b4-ab24-44fc-a390-37fffc6cb459 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.707867 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945e1b4-ab24-44fc-a390-37fffc6cb459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.709676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945e1b4-ab24-44fc-a390-37fffc6cb459 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.729062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 938/1894] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:21 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:09:21.731003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945e1b4-ab24-44fc-a390-37fffc6cb459 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:21.742415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945e1b4-ab24-44fc-a390-37fffc6cb459 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.758689 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70efc6-cb4d-49ee-a106-a95fbc26b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.759578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70efc6-cb4d-49ee-a106-a95fbc26b80e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.760649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70efc6-cb4d-49ee-a106-a95fbc26b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.761758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fe627-b009-48e9-8116-f050b0011689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.762533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fe627-b009-48e9-8116-f050b0011689 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.762901 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70efc6-cb4d-49ee-a106-a95fbc26b80e admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.763028 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fe627-b009-48e9-8116-f050b0011689 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.764097 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fe627-b009-48e9-8116-f050b0011689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.764735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70efc6-cb4d-49ee-a106-a95fbc26b80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.765792 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ba6fe627-b009-48e9-8116-f050b0011689 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:21.767731 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70efc6-cb4d-49ee-a106-a95fbc26b80e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.795939 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 939/1895] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:21 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:21.799948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70efc6-cb4d-49ee-a106-a95fbc26b80e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:21.811081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70efc6-cb4d-49ee-a106-a95fbc26b80e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:21.816191 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c7db9-7c25-416c-9cce-7b20ba1c5f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:21.818049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c7db9-7c25-416c-9cce-7b20ba1c5f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.818475 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c7db9-7c25-416c-9cce-7b20ba1c5f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.818986 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c7db9-7c25-416c-9cce-7b20ba1c5f06 admin admin] PATH_INFO: `/v3/projects/77f2fdb6d4114797a4c091eb7e0c3048/users/dd31fb27a5d847cd944525c91975e852/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.835373 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c7db9-7c25-416c-9cce-7b20ba1c5f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f2fdb6d4114797a4c091eb7e0c3048, user_id=dd31fb27a5d847cd944525c91975e852, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.838142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c7db9-7c25-416c-9cce-7b20ba1c5f06 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.841293 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fe627-b009-48e9-8116-f050b0011689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:21.843025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fe627-b009-48e9-8116-f050b0011689 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:21.853677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 957/1896] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:21 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:21.872428 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 940/1897] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:21 2021] PUT /identity/v3/projects/77f2fdb6d4114797a4c091eb7e0c3048/users/dd31fb27a5d847cd944525c91975e852/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:21.873815 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827eb57-a508-4d10-a9ac-57fa86376c11 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:21.874162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827eb57-a508-4d10-a9ac-57fa86376c11 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:21.874490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827eb57-a508-4d10-a9ac-57fa86376c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:21.912136 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-f827eb57-a508-4d10-a9ac-57fa86376c11 None None] MFA Rules not processed for user `dd31fb27a5d847cd944525c91975e852`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:21.913371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f827eb57-a508-4d10-a9ac-57fa86376c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:21.987030 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 958/1898] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:21 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:21.991810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c7db9-7c25-416c-9cce-7b20ba1c5f06 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:22.098756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c7db9-7c25-416c-9cce-7b20ba1c5f06 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:22.111283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b722197-006f-4392-87be-79ff56540477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:22.111960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b722197-006f-4392-87be-79ff56540477 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:22.112260 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b722197-006f-4392-87be-79ff56540477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:22.112684 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b722197-006f-4392-87be-79ff56540477 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:22.113326 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b722197-006f-4392-87be-79ff56540477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:22.115299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b722197-006f-4392-87be-79ff56540477 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:22.151830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 941/1899] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:21 2021] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:22.160624 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827eb57-a508-4d10-a9ac-57fa86376c11 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:22.177533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827eb57-a508-4d10-a9ac-57fa86376c11 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:22.239838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c1d77-e21b-4de6-a508-58b3a001bed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:22.240580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c1d77-e21b-4de6-a508-58b3a001bed7 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:22.240926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c1d77-e21b-4de6-a508-58b3a001bed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:22.241201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c1d77-e21b-4de6-a508-58b3a001bed7 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:22.241903 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c1d77-e21b-4de6-a508-58b3a001bed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:22.243839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c1d77-e21b-4de6-a508-58b3a001bed7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:22.264050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 959/1900] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:22 2021] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:22.268213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b722197-006f-4392-87be-79ff56540477 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:22.278734 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b722197-006f-4392-87be-79ff56540477 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:22.283517 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b4854-8088-4ef4-a376-0e24f9ec9d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:22.284174 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b4854-8088-4ef4-a376-0e24f9ec9d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:22.284462 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b4854-8088-4ef4-a376-0e24f9ec9d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:22.284736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b4854-8088-4ef4-a376-0e24f9ec9d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:22.285472 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b4854-8088-4ef4-a376-0e24f9ec9d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:22.287101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b4854-8088-4ef4-a376-0e24f9ec9d0c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:22.297765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 942/1901] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:22.302038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c1d77-e21b-4de6-a508-58b3a001bed7 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:22.312491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c1d77-e21b-4de6-a508-58b3a001bed7 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:22.317971 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec654885-64e0-484a-a258-c1295226f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:22.318881 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec654885-64e0-484a-a258-c1295226f54a admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:22.319163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec654885-64e0-484a-a258-c1295226f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:22.319441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec654885-64e0-484a-a258-c1295226f54a admin admin] PATH_INFO: `/v3/projects/72b97e09d45f4049a8fa276dad58d281/users/6f9a0cee2b3a4554ad1b3857becfb1e6/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:22.334941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec654885-64e0-484a-a258-c1295226f54a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b97e09d45f4049a8fa276dad58d281, user_id=6f9a0cee2b3a4554ad1b3857becfb1e6, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:22.337736 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec654885-64e0-484a-a258-c1295226f54a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:22.356010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 960/1902] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:22 2021] PUT /identity/v3/projects/72b97e09d45f4049a8fa276dad58d281/users/6f9a0cee2b3a4554ad1b3857becfb1e6/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:22.360931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b4854-8088-4ef4-a376-0e24f9ec9d0c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:22.372619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b4854-8088-4ef4-a376-0e24f9ec9d0c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:22.428567 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5baa4-f31b-4b01-a0e0-c11f2034ed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:22.429231 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5baa4-f31b-4b01-a0e0-c11f2034ed73 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:22.429519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5baa4-f31b-4b01-a0e0-c11f2034ed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:22.429798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5baa4-f31b-4b01-a0e0-c11f2034ed73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:22.430574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5baa4-f31b-4b01-a0e0-c11f2034ed73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:22.432278 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5baa4-f31b-4b01-a0e0-c11f2034ed73 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:22.442802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 943/1903] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:22 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:22.447321 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec654885-64e0-484a-a258-c1295226f54a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:22.458676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec654885-64e0-484a-a258-c1295226f54a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:22.463290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c3eda-61be-4712-bebe-add3e3c92e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:22.464165 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c3eda-61be-4712-bebe-add3e3c92e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:22.464446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c3eda-61be-4712-bebe-add3e3c92e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:22.464734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c3eda-61be-4712-bebe-add3e3c92e1b admin admin] PATH_INFO: `/v3/projects/72b97e09d45f4049a8fa276dad58d281/users/6f9a0cee2b3a4554ad1b3857becfb1e6/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:22.466715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c3eda-61be-4712-bebe-add3e3c92e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b97e09d45f4049a8fa276dad58d281, user_id=6f9a0cee2b3a4554ad1b3857becfb1e6, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:22.469433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c3eda-61be-4712-bebe-add3e3c92e1b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:22.480146 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 961/1904] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:22 2021] PUT /identity/v3/projects/72b97e09d45f4049a8fa276dad58d281/users/6f9a0cee2b3a4554ad1b3857becfb1e6/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:22.491081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69c8f2-525d-4d98-908c-771cec03fbe3 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:22.491371 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69c8f2-525d-4d98-908c-771cec03fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:22.491646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69c8f2-525d-4d98-908c-771cec03fbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:22.518562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-1f69c8f2-525d-4d98-908c-771cec03fbe3 None None] MFA Rules not processed for user `6f9a0cee2b3a4554ad1b3857becfb1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:22.519781 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-1f69c8f2-525d-4d98-908c-771cec03fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:22.586172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 944/1905] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:22 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:22.597062 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c3eda-61be-4712-bebe-add3e3c92e1b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:22.598815 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a96c3eda-61be-4712-bebe-add3e3c92e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:22.654989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c3eda-61be-4712-bebe-add3e3c92e1b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:22.658619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7a7a0-0a54-440a-82da-2f42e7262fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:22.659251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7a7a0-0a54-440a-82da-2f42e7262fbb service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:22.659530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7a7a0-0a54-440a-82da-2f42e7262fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:22.659802 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7a7a0-0a54-440a-82da-2f42e7262fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:22.669112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7a7a0-0a54-440a-82da-2f42e7262fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:22.670552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7a7a0-0a54-440a-82da-2f42e7262fbb service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:22.679675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 962/1906] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:22 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:22.757366 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69c8f2-525d-4d98-908c-771cec03fbe3 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:22.766932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69c8f2-525d-4d98-908c-771cec03fbe3 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:22.770650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e8fe3-220e-4ec8-b457-32a3e91b10df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:22.771359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e8fe3-220e-4ec8-b457-32a3e91b10df service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:22.771708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e8fe3-220e-4ec8-b457-32a3e91b10df service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:22.772051 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e8fe3-220e-4ec8-b457-32a3e91b10df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:22.952345 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e8fe3-220e-4ec8-b457-32a3e91b10df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:22.953927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e8fe3-220e-4ec8-b457-32a3e91b10df service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:22.962901 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 945/1907] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:22 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:26.865045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7a7a0-0a54-440a-82da-2f42e7262fbb service cinder] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:26.935007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7a7a0-0a54-440a-82da-2f42e7262fbb service cinder] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:26.939693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:26.940630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:26.940909 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:26.941186 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] PATH_INFO: `/v3/users/3f12b2d45ed14b6bb2ea0c40420a4f8c` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:26.942515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f12b2d45ed14b6bb2ea0c40420a4f8c)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:26.944508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:26.997722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f12b2d45ed14b6bb2ea0c40420a4f8c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:26.998492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f12b2d45ed14b6bb2ea0c40420a4f8c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.005724 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f12b2d45ed14b6bb2ea0c40420a4f8c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.006393 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f12b2d45ed14b6bb2ea0c40420a4f8c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.021347 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f12b2d45ed14b6bb2ea0c40420a4f8c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.035782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 963/1908] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:26 2021] DELETE /identity/v3/users/3f12b2d45ed14b6bb2ea0c40420a4f8c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:27.040230 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899577f1-4dfa-4996-8413-279948772d7e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:27.040723 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899577f1-4dfa-4996-8413-279948772d7e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:27.040942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899577f1-4dfa-4996-8413-279948772d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:27.065689 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-899577f1-4dfa-4996-8413-279948772d7e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:27.066950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-899577f1-4dfa-4996-8413-279948772d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:27.158645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 946/1909] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:27.169000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:27.170544 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:27.258967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76491283-24bc-4f69-8e9e-9060d076f3bf admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:27.262812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf22268-9c99-4549-843a-7a93485b1860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:27.263455 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf22268-9c99-4549-843a-7a93485b1860 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:27.263733 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf22268-9c99-4549-843a-7a93485b1860 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:27.264006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf22268-9c99-4549-843a-7a93485b1860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:27.274235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf22268-9c99-4549-843a-7a93485b1860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:27.275950 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf22268-9c99-4549-843a-7a93485b1860 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:27.288649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 964/1910] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:27.593587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899577f1-4dfa-4996-8413-279948772d7e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:27.595583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-899577f1-4dfa-4996-8413-279948772d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:27.616856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899577f1-4dfa-4996-8413-279948772d7e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:27.626237 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:27.627405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:27.627890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:27.628456 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] PATH_INFO: `/v3/projects/c0d9c4dfbc1f409d8017dcdc2e770a74` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:27.631513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d9c4dfbc1f409d8017dcdc2e770a74)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:27.633493 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:27.703971 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d9c4dfbc1f409d8017dcdc2e770a74', 'request_id': 'req-6620e793-8c6c-4bca-a762-81f1d0596d42'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.713838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d9c4dfbc1f409d8017dcdc2e770a74', 'request_id': 'req-6620e793-8c6c-4bca-a762-81f1d0596d42'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.726004 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d9c4dfbc1f409d8017dcdc2e770a74', 'request_id': 'req-6620e793-8c6c-4bca-a762-81f1d0596d42'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.749430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] The token cache is being invalidate because project c0d9c4dfbc1f409d8017dcdc2e770a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:27.749736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.750454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.754460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 947/1911] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:27 2021] DELETE /identity/v3/projects/c0d9c4dfbc1f409d8017dcdc2e770a74 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:27.756106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf22268-9c99-4549-843a-7a93485b1860 service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:27.767297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf22268-9c99-4549-843a-7a93485b1860 service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:27.859310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5df89-aea1-4292-bd50-a3b79addf411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:27.860299 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5df89-aea1-4292-bd50-a3b79addf411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:27.860584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5df89-aea1-4292-bd50-a3b79addf411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:27.860902 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5df89-aea1-4292-bd50-a3b79addf411 admin admin] PATH_INFO: `/v3/users/f983edca215049998e64f5e0d4d9e4b6` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:27.862233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5df89-aea1-4292-bd50-a3b79addf411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f983edca215049998e64f5e0d4d9e4b6)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:27.864451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5df89-aea1-4292-bd50-a3b79addf411 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:27.924319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3db5df89-aea1-4292-bd50-a3b79addf411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f983edca215049998e64f5e0d4d9e4b6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.925671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3db5df89-aea1-4292-bd50-a3b79addf411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f983edca215049998e64f5e0d4d9e4b6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.934694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3db5df89-aea1-4292-bd50-a3b79addf411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f983edca215049998e64f5e0d4d9e4b6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.935655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3db5df89-aea1-4292-bd50-a3b79addf411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f983edca215049998e64f5e0d4d9e4b6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.949746 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3db5df89-aea1-4292-bd50-a3b79addf411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f983edca215049998e64f5e0d4d9e4b6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:27.966357 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 965/1912] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:27 2021] DELETE /identity/v3/users/f983edca215049998e64f5e0d4d9e4b6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:28.251279 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:28.253017 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:28.268682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620e793-8c6c-4bca-a762-81f1d0596d42 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:28.336901 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:28.337767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:28.338044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:28.338347 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186 admin admin] PATH_INFO: `/v3/projects/0d01ddda49da48e9aed4dee80da1243f` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:28.340112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d01ddda49da48e9aed4dee80da1243f)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:28.342411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:28.397601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d01ddda49da48e9aed4dee80da1243f', 'request_id': 'req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:28.404009 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d01ddda49da48e9aed4dee80da1243f', 'request_id': 'req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:28.410378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d01ddda49da48e9aed4dee80da1243f', 'request_id': 'req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:28.423290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186 admin admin] The token cache is being invalidate because project 0d01ddda49da48e9aed4dee80da1243f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:28.423572 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:28.424422 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1a4a4e77-ef4f-4b45-b624-18e8b1a8a186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:28.426165 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 948/1913] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:28 2021] DELETE /identity/v3/projects/0d01ddda49da48e9aed4dee80da1243f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:28.431869 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c001-febb-4d96-943d-487fb8b57f22 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:28.432154 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c001-febb-4d96-943d-487fb8b57f22 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:28.432989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c001-febb-4d96-943d-487fb8b57f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:28.450958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a5c1c001-febb-4d96-943d-487fb8b57f22 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:28.452335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a5c1c001-febb-4d96-943d-487fb8b57f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:28.512586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 966/1914] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:28.520550 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12ccba-c25a-4761-b7eb-1145e6e88883 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:28.520842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12ccba-c25a-4761-b7eb-1145e6e88883 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:28.521131 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12ccba-c25a-4761-b7eb-1145e6e88883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:28.540166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-9c12ccba-c25a-4761-b7eb-1145e6e88883 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:28.541364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9c12ccba-c25a-4761-b7eb-1145e6e88883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:28.549154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 949/1915] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:28.553367 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1c001-febb-4d96-943d-487fb8b57f22 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:28.563218 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1c001-febb-4d96-943d-487fb8b57f22 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:28.567866 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c3a59-1739-4e15-9b3b-a044258eda02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:28.568515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c3a59-1739-4e15-9b3b-a044258eda02 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:28.568802 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c3a59-1739-4e15-9b3b-a044258eda02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:28.569082 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c3a59-1739-4e15-9b3b-a044258eda02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:28.569817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c3a59-1739-4e15-9b3b-a044258eda02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:28.570135 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c3a59-1739-4e15-9b3b-a044258eda02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:28.571772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c3a59-1739-4e15-9b3b-a044258eda02 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:28.587528 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 967/1916] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:09:28.589112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12ccba-c25a-4761-b7eb-1145e6e88883 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:28.602786 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12ccba-c25a-4761-b7eb-1145e6e88883 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:28.608055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97804b-860b-4fe5-be2c-b30679249694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:28.608714 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97804b-860b-4fe5-be2c-b30679249694 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:28.608995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97804b-860b-4fe5-be2c-b30679249694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:28.609272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97804b-860b-4fe5-be2c-b30679249694 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:28.610019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97804b-860b-4fe5-be2c-b30679249694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:28.611967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97804b-860b-4fe5-be2c-b30679249694 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:28.639136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 950/1917] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:28 2021] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:28.643499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c3a59-1739-4e15-9b3b-a044258eda02 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:28.654401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c3a59-1739-4e15-9b3b-a044258eda02 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:28.706936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fed11e-cd33-4e85-a6b3-36ec75bfb635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:28.707597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed11e-cd33-4e85-a6b3-36ec75bfb635 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:28.707876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed11e-cd33-4e85-a6b3-36ec75bfb635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:28.708143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed11e-cd33-4e85-a6b3-36ec75bfb635 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:28.708846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fed11e-cd33-4e85-a6b3-36ec75bfb635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:28.710777 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fed11e-cd33-4e85-a6b3-36ec75bfb635 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:28.732300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 968/1918] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:28 2021] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:28.735198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97804b-860b-4fe5-be2c-b30679249694 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:28.745432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97804b-860b-4fe5-be2c-b30679249694 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:28.749966 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ec20a-2b3b-4730-82e3-55b110576504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:28.750640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ec20a-2b3b-4730-82e3-55b110576504 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:28.750925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ec20a-2b3b-4730-82e3-55b110576504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:28.751199 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ec20a-2b3b-4730-82e3-55b110576504 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:28.751927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ec20a-2b3b-4730-82e3-55b110576504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:28.753494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ec20a-2b3b-4730-82e3-55b110576504 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:28.764251 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 951/1919] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:28.767977 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fed11e-cd33-4e85-a6b3-36ec75bfb635 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:28.778136 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fed11e-cd33-4e85-a6b3-36ec75bfb635 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:28.782696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448453b-5dda-4261-a5d7-8d34d38456ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:28.783443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448453b-5dda-4261-a5d7-8d34d38456ed admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:28.783728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448453b-5dda-4261-a5d7-8d34d38456ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:28.784003 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448453b-5dda-4261-a5d7-8d34d38456ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:28.784762 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448453b-5dda-4261-a5d7-8d34d38456ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:28.786329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448453b-5dda-4261-a5d7-8d34d38456ed admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:28.795842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 969/1920] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:28 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:28.800256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ec20a-2b3b-4730-82e3-55b110576504 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:28.810096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ec20a-2b3b-4730-82e3-55b110576504 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:28.814804 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5bce1-2486-4cab-b42f-f123004f117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:28.815663 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5bce1-2486-4cab-b42f-f123004f117b admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:28.815942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5bce1-2486-4cab-b42f-f123004f117b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:28.816243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5bce1-2486-4cab-b42f-f123004f117b admin admin] PATH_INFO: `/v3/projects/407c5c21060f4886958c48cbe475da5f/users/7066c62f8c784f1eadcdeb530ead6a4f/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:28.830892 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5bce1-2486-4cab-b42f-f123004f117b admin admin] RBAC: Authorizing `identity:create_grant(project_id=407c5c21060f4886958c48cbe475da5f, user_id=7066c62f8c784f1eadcdeb530ead6a4f, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:28.833555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5bce1-2486-4cab-b42f-f123004f117b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:28.847601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 952/1921] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:28 2021] PUT /identity/v3/projects/407c5c21060f4886958c48cbe475da5f/users/7066c62f8c784f1eadcdeb530ead6a4f/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:28.859235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37109cd-1590-4ef6-8a03-cb60b2645faf None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:28.859525 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37109cd-1590-4ef6-8a03-cb60b2645faf None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:28.859803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37109cd-1590-4ef6-8a03-cb60b2645faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:28.888131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a37109cd-1590-4ef6-8a03-cb60b2645faf None None] MFA Rules not processed for user `7066c62f8c784f1eadcdeb530ead6a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:28.889358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a37109cd-1590-4ef6-8a03-cb60b2645faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:28.953676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 970/1922] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:28 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:28.966077 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5bce1-2486-4cab-b42f-f123004f117b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:28.967801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d8d5bce1-2486-4cab-b42f-f123004f117b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:29.024220 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5bce1-2486-4cab-b42f-f123004f117b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:29.029153 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabbee9-516e-4b50-a8b9-958855b052ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:29.029950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabbee9-516e-4b50-a8b9-958855b052ea service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:29.030292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabbee9-516e-4b50-a8b9-958855b052ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:29.030542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabbee9-516e-4b50-a8b9-958855b052ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:29.039243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabbee9-516e-4b50-a8b9-958855b052ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:29.041247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabbee9-516e-4b50-a8b9-958855b052ea service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:29.052576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 953/1923] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:28 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:31.272275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37109cd-1590-4ef6-8a03-cb60b2645faf None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:31.273696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a37109cd-1590-4ef6-8a03-cb60b2645faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:31.337035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37109cd-1590-4ef6-8a03-cb60b2645faf None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:31.342411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:31.343285 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:31.343566 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:31.343840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] PATH_INFO: `/v3/users/dd31fb27a5d847cd944525c91975e852` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:31.345045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd31fb27a5d847cd944525c91975e852)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:31.347284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:31.392773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd31fb27a5d847cd944525c91975e852'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:31.393350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd31fb27a5d847cd944525c91975e852'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:31.400268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd31fb27a5d847cd944525c91975e852'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:31.401672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd31fb27a5d847cd944525c91975e852'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:31.413557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd31fb27a5d847cd944525c91975e852'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:31.427102 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 971/1924] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:31 2021] DELETE /identity/v3/users/dd31fb27a5d847cd944525c91975e852 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:31.431941 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedd4e6-dae4-430a-8df7-25198cfed84a None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:31.433224 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedd4e6-dae4-430a-8df7-25198cfed84a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:31.433224 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedd4e6-dae4-430a-8df7-25198cfed84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:31.450518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-fbedd4e6-dae4-430a-8df7-25198cfed84a None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:31.451719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-fbedd4e6-dae4-430a-8df7-25198cfed84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:31.518821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 954/1925] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:31.528997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:31.530432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:31.584749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57cddb-6590-4666-86cf-406c0f383e54 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:31.588399 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8de773-787c-49ed-96be-cb46d87f5726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:31.589056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8de773-787c-49ed-96be-cb46d87f5726 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:31.589337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8de773-787c-49ed-96be-cb46d87f5726 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:31.589613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8de773-787c-49ed-96be-cb46d87f5726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:31.598979 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8de773-787c-49ed-96be-cb46d87f5726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:31.600391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8de773-787c-49ed-96be-cb46d87f5726 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:31.610354 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 972/1926] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:31.884727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedd4e6-dae4-430a-8df7-25198cfed84a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:31.886278 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-fbedd4e6-dae4-430a-8df7-25198cfed84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:31.903674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedd4e6-dae4-430a-8df7-25198cfed84a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:31.908245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:31.909091 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:31.909374 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:31.909647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] PATH_INFO: `/v3/projects/77f2fdb6d4114797a4c091eb7e0c3048` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:31.910865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f2fdb6d4114797a4c091eb7e0c3048)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:31.912759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:31.958006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f2fdb6d4114797a4c091eb7e0c3048', 'request_id': 'req-d20ef649-52d4-4317-9656-fc54f72138b0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:31.963146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f2fdb6d4114797a4c091eb7e0c3048', 'request_id': 'req-d20ef649-52d4-4317-9656-fc54f72138b0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:31.969882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f2fdb6d4114797a4c091eb7e0c3048', 'request_id': 'req-d20ef649-52d4-4317-9656-fc54f72138b0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:31.988628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] The token cache is being invalidate because project 77f2fdb6d4114797a4c091eb7e0c3048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:31.988912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:31.989543 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:31.991198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 955/1927] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:31 2021] DELETE /identity/v3/projects/77f2fdb6d4114797a4c091eb7e0c3048 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:31.995438 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8de773-787c-49ed-96be-cb46d87f5726 service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:32.006847 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8de773-787c-49ed-96be-cb46d87f5726 service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:32.061935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3a49f-38b6-487b-b310-a142da8fc1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:32.062835 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3a49f-38b6-487b-b310-a142da8fc1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:32.063122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3a49f-38b6-487b-b310-a142da8fc1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:32.063401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3a49f-38b6-487b-b310-a142da8fc1cc admin admin] PATH_INFO: `/v3/users/6f9a0cee2b3a4554ad1b3857becfb1e6` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:32.064608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3a49f-38b6-487b-b310-a142da8fc1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9a0cee2b3a4554ad1b3857becfb1e6)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:32.066555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3a49f-38b6-487b-b310-a142da8fc1cc admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:32.118422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-48e3a49f-38b6-487b-b310-a142da8fc1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9a0cee2b3a4554ad1b3857becfb1e6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:32.119164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-48e3a49f-38b6-487b-b310-a142da8fc1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9a0cee2b3a4554ad1b3857becfb1e6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:32.126533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-48e3a49f-38b6-487b-b310-a142da8fc1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9a0cee2b3a4554ad1b3857becfb1e6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:32.127173 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-48e3a49f-38b6-487b-b310-a142da8fc1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9a0cee2b3a4554ad1b3857becfb1e6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:32.138963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-48e3a49f-38b6-487b-b310-a142da8fc1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9a0cee2b3a4554ad1b3857becfb1e6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:32.151939 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 973/1928] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:31 2021] DELETE /identity/v3/users/6f9a0cee2b3a4554ad1b3857becfb1e6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:32.405978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:32.407423 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:32.421030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ef649-52d4-4317-9656-fc54f72138b0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:32.476836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:32.477679 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:32.477959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:32.478230 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1 admin admin] PATH_INFO: `/v3/projects/72b97e09d45f4049a8fa276dad58d281` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:32.479955 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b97e09d45f4049a8fa276dad58d281)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:32.481854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:32.530683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b97e09d45f4049a8fa276dad58d281', 'request_id': 'req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:32.536652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b97e09d45f4049a8fa276dad58d281', 'request_id': 'req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:32.543012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b97e09d45f4049a8fa276dad58d281', 'request_id': 'req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:32.557750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1 admin admin] The token cache is being invalidate because project 72b97e09d45f4049a8fa276dad58d281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:32.558038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:32.559057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9007c9e7-f5e0-474d-bac8-7f89605c9ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:32.564819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 956/1929] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:32 2021] DELETE /identity/v3/projects/72b97e09d45f4049a8fa276dad58d281 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:32.566674 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb66c9-8049-4a12-9564-55457c04fbc2 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:32.567508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb66c9-8049-4a12-9564-55457c04fbc2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:32.567794 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb66c9-8049-4a12-9564-55457c04fbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:32.586024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-29cb66c9-8049-4a12-9564-55457c04fbc2 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:32.587280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-29cb66c9-8049-4a12-9564-55457c04fbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:32.647690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 974/1930] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:32.655586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e8cf-6893-4d40-86cb-ae8e63550cc7 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:32.655876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e8cf-6893-4d40-86cb-ae8e63550cc7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:32.656152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e8cf-6893-4d40-86cb-ae8e63550cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:32.673796 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e590e8cf-6893-4d40-86cb-ae8e63550cc7 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:32.675105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e590e8cf-6893-4d40-86cb-ae8e63550cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:32.684133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 957/1931] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:32.687987 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb66c9-8049-4a12-9564-55457c04fbc2 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:32.698827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb66c9-8049-4a12-9564-55457c04fbc2 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:32.703688 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60eaa9-ad16-4f2b-864f-cc097f5bf0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:32.704436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60eaa9-ad16-4f2b-864f-cc097f5bf0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:32.704803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60eaa9-ad16-4f2b-864f-cc097f5bf0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:32.705210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60eaa9-ad16-4f2b-864f-cc097f5bf0c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:32.706013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60eaa9-ad16-4f2b-864f-cc097f5bf0c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:32.706404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60eaa9-ad16-4f2b-864f-cc097f5bf0c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:32.708037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60eaa9-ad16-4f2b-864f-cc097f5bf0c9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:32.720019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 975/1932] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:09:32.724943 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590e8cf-6893-4d40-86cb-ae8e63550cc7 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:32.735121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590e8cf-6893-4d40-86cb-ae8e63550cc7 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:32.739739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6d749-b055-41e3-bebd-71478fd5c35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:32.740432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6d749-b055-41e3-bebd-71478fd5c35f admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:32.740699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6d749-b055-41e3-bebd-71478fd5c35f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:32.740973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6d749-b055-41e3-bebd-71478fd5c35f admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:32.741683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6d749-b055-41e3-bebd-71478fd5c35f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:32.743632 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6d749-b055-41e3-bebd-71478fd5c35f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:32.768524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 958/1933] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:32 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:32.772714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60eaa9-ad16-4f2b-864f-cc097f5bf0c9 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:32.784071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60eaa9-ad16-4f2b-864f-cc097f5bf0c9 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:32.837934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc1b0b-9bf1-4c96-ba96-f1489f182f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:32.839333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc1b0b-9bf1-4c96-ba96-f1489f182f1d admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:32.839706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc1b0b-9bf1-4c96-ba96-f1489f182f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:32.839932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc1b0b-9bf1-4c96-ba96-f1489f182f1d admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:32.840631 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc1b0b-9bf1-4c96-ba96-f1489f182f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:32.842679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc1b0b-9bf1-4c96-ba96-f1489f182f1d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:32.867284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 976/1934] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:32 2021] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:32.872295 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6d749-b055-41e3-bebd-71478fd5c35f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:32.882672 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6d749-b055-41e3-bebd-71478fd5c35f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:32.888249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ee45d-35ab-40c0-9c49-90550f99ccdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:32.888897 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ee45d-35ab-40c0-9c49-90550f99ccdc admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:32.889177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ee45d-35ab-40c0-9c49-90550f99ccdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:32.889450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ee45d-35ab-40c0-9c49-90550f99ccdc admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:32.890423 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ee45d-35ab-40c0-9c49-90550f99ccdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:32.892139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ee45d-35ab-40c0-9c49-90550f99ccdc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:32.902208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 959/1935] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:32.906226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc1b0b-9bf1-4c96-ba96-f1489f182f1d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:32.916204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc1b0b-9bf1-4c96-ba96-f1489f182f1d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:32.921023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02923e-03ae-462f-8f59-bbc04e866ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:32.921668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02923e-03ae-462f-8f59-bbc04e866ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:32.921948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02923e-03ae-462f-8f59-bbc04e866ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:32.922221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02923e-03ae-462f-8f59-bbc04e866ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:32.922996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02923e-03ae-462f-8f59-bbc04e866ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:32.924656 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02923e-03ae-462f-8f59-bbc04e866ff9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:32.934933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 977/1936] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:32.938935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ee45d-35ab-40c0-9c49-90550f99ccdc admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:32.949228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ee45d-35ab-40c0-9c49-90550f99ccdc admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:32.953782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a462963-9393-46fe-af19-bf96425aa258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:32.954691 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a462963-9393-46fe-af19-bf96425aa258 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:32.954956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a462963-9393-46fe-af19-bf96425aa258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:32.955233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a462963-9393-46fe-af19-bf96425aa258 admin admin] PATH_INFO: `/v3/projects/f0c87ba9f6794ec083b7527e3429b72d/users/d17a127504094f618b8b36d0b8ac405f/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:32.969024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a462963-9393-46fe-af19-bf96425aa258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c87ba9f6794ec083b7527e3429b72d, user_id=d17a127504094f618b8b36d0b8ac405f, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:32.971929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a462963-9393-46fe-af19-bf96425aa258 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:32.984352 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 960/1937] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:32 2021] PUT /identity/v3/projects/f0c87ba9f6794ec083b7527e3429b72d/users/d17a127504094f618b8b36d0b8ac405f/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:32.989266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff42a-df3f-44bb-9233-923e18cfbfcd None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:32.989557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff42a-df3f-44bb-9233-923e18cfbfcd None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:32.989838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff42a-df3f-44bb-9233-923e18cfbfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:33.007793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-b7cff42a-df3f-44bb-9233-923e18cfbfcd None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:33.008988 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b7cff42a-df3f-44bb-9233-923e18cfbfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:33.065924 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 978/1938] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:33.076389 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a462963-9393-46fe-af19-bf96425aa258 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:33.078040 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7a462963-9393-46fe-af19-bf96425aa258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:33.132553 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a462963-9393-46fe-af19-bf96425aa258 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:33.136893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f76ce-a96e-4d36-a590-21d4e3b2dd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:33.137513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f76ce-a96e-4d36-a590-21d4e3b2dd05 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:33.137925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f76ce-a96e-4d36-a590-21d4e3b2dd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:33.138306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f76ce-a96e-4d36-a590-21d4e3b2dd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:33.147494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f76ce-a96e-4d36-a590-21d4e3b2dd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:33.148916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f76ce-a96e-4d36-a590-21d4e3b2dd05 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:33.159139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 961/1939] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:33.774023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a2324-3e37-4430-93ca-781fc76c2c7e None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:33.774568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a2324-3e37-4430-93ca-781fc76c2c7e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:33.774666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a2324-3e37-4430-93ca-781fc76c2c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:33.810029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-3e6a2324-3e37-4430-93ca-781fc76c2c7e None None] MFA Rules not processed for user `d17a127504094f618b8b36d0b8ac405f`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:33.811606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-3e6a2324-3e37-4430-93ca-781fc76c2c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:33.898202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 979/1940] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:33 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:33.903332 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f76ce-a96e-4d36-a590-21d4e3b2dd05 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:33.913350 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f76ce-a96e-4d36-a590-21d4e3b2dd05 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:33.918758 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c37c7-8eb6-430e-ac40-bbcd09da3e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:33.919406 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c37c7-8eb6-430e-ac40-bbcd09da3e8d admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:33.919684 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c37c7-8eb6-430e-ac40-bbcd09da3e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:33.919986 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c37c7-8eb6-430e-ac40-bbcd09da3e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:33.920683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c37c7-8eb6-430e-ac40-bbcd09da3e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:33.922586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c37c7-8eb6-430e-ac40-bbcd09da3e8d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:33.950793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 962/1941] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:33 2021] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:33.955085 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a2324-3e37-4430-93ca-781fc76c2c7e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:33.965609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a2324-3e37-4430-93ca-781fc76c2c7e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:34.019713 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70263b91-4b4d-47da-b32a-a06e493da643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:34.020374 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70263b91-4b4d-47da-b32a-a06e493da643 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:34.020653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70263b91-4b4d-47da-b32a-a06e493da643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:34.020952 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70263b91-4b4d-47da-b32a-a06e493da643 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:34.021661 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70263b91-4b4d-47da-b32a-a06e493da643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:34.023609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70263b91-4b4d-47da-b32a-a06e493da643 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:34.043686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 980/1942] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:33 2021] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:34.047759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c37c7-8eb6-430e-ac40-bbcd09da3e8d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:34.058268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c37c7-8eb6-430e-ac40-bbcd09da3e8d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:34.062780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee624449-09b0-433d-888a-b1e53a3bffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:34.063421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624449-09b0-433d-888a-b1e53a3bffee admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:34.063704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624449-09b0-433d-888a-b1e53a3bffee admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:34.063978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624449-09b0-433d-888a-b1e53a3bffee admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:34.064701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee624449-09b0-433d-888a-b1e53a3bffee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:34.066274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee624449-09b0-433d-888a-b1e53a3bffee admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:34.077301 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 963/1943] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:34.081396 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70263b91-4b4d-47da-b32a-a06e493da643 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:34.091755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70263b91-4b4d-47da-b32a-a06e493da643 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:34.096519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184db314-6c4c-4b1a-8678-a394e8b072cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:34.097376 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184db314-6c4c-4b1a-8678-a394e8b072cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:34.097676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184db314-6c4c-4b1a-8678-a394e8b072cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:34.097942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184db314-6c4c-4b1a-8678-a394e8b072cc admin admin] PATH_INFO: `/v3/projects/e375f27d76b34600ab9f511990fc57c9/users/63dffbff15ff4d4c82adf88258fcffac/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:34.113289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184db314-6c4c-4b1a-8678-a394e8b072cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e375f27d76b34600ab9f511990fc57c9, user_id=63dffbff15ff4d4c82adf88258fcffac, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:34.117023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184db314-6c4c-4b1a-8678-a394e8b072cc admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:34.131172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 981/1944] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:34 2021] PUT /identity/v3/projects/e375f27d76b34600ab9f511990fc57c9/users/63dffbff15ff4d4c82adf88258fcffac/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:34.136135 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee624449-09b0-433d-888a-b1e53a3bffee admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:34.146167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee624449-09b0-433d-888a-b1e53a3bffee admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:34.205173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e7483-ba00-4da1-81cd-928ddb8da890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:34.205890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e7483-ba00-4da1-81cd-928ddb8da890 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:34.206170 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e7483-ba00-4da1-81cd-928ddb8da890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:34.206539 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e7483-ba00-4da1-81cd-928ddb8da890 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:34.207273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e7483-ba00-4da1-81cd-928ddb8da890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:34.208840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e7483-ba00-4da1-81cd-928ddb8da890 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:34.219570 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 964/1945] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:34 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:09:34.223884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184db314-6c4c-4b1a-8678-a394e8b072cc admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:34.235351 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184db314-6c4c-4b1a-8678-a394e8b072cc admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:34.239909 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905fb9e-4eb5-4149-a124-3abed029b85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:34.240783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905fb9e-4eb5-4149-a124-3abed029b85d admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:34.241288 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905fb9e-4eb5-4149-a124-3abed029b85d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:34.241575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905fb9e-4eb5-4149-a124-3abed029b85d admin admin] PATH_INFO: `/v3/projects/e375f27d76b34600ab9f511990fc57c9/users/63dffbff15ff4d4c82adf88258fcffac/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:34.243744 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905fb9e-4eb5-4149-a124-3abed029b85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e375f27d76b34600ab9f511990fc57c9, user_id=63dffbff15ff4d4c82adf88258fcffac, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:34.254224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905fb9e-4eb5-4149-a124-3abed029b85d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:34.257456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 982/1946] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:34 2021] PUT /identity/v3/projects/e375f27d76b34600ab9f511990fc57c9/users/63dffbff15ff4d4c82adf88258fcffac/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:34.865280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b488ff9-eaa6-4e8f-a04b-b8544401c9a9 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:34.865280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b488ff9-eaa6-4e8f-a04b-b8544401c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:34.865280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b488ff9-eaa6-4e8f-a04b-b8544401c9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:34.895710 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-9b488ff9-eaa6-4e8f-a04b-b8544401c9a9 None None] MFA Rules not processed for user `63dffbff15ff4d4c82adf88258fcffac`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:34.897842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9b488ff9-eaa6-4e8f-a04b-b8544401c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:35.029720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 965/1947] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:34 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:35.076786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905fb9e-4eb5-4149-a124-3abed029b85d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:35.078699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-7905fb9e-4eb5-4149-a124-3abed029b85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:35.161281 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905fb9e-4eb5-4149-a124-3abed029b85d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:35.165766 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4f6d1-b3b0-4182-af03-77186ab20a91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:35.166199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4f6d1-b3b0-4182-af03-77186ab20a91 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:35.167286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4f6d1-b3b0-4182-af03-77186ab20a91 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:35.167553 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4f6d1-b3b0-4182-af03-77186ab20a91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:35.223953 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4f6d1-b3b0-4182-af03-77186ab20a91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:35.225556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4f6d1-b3b0-4182-af03-77186ab20a91 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:35.235321 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 983/1948] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:35 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:09:35.635004 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b488ff9-eaa6-4e8f-a04b-b8544401c9a9 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:35.637776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9b488ff9-eaa6-4e8f-a04b-b8544401c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:35.705607 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b488ff9-eaa6-4e8f-a04b-b8544401c9a9 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:35.710104 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:35.711002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:35.711283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:35.712377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] PATH_INFO: `/v3/users/046d3c176330479e99bc839aa1c5f213` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:35.712734 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=046d3c176330479e99bc839aa1c5f213)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:35.714914 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:35.757468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046d3c176330479e99bc839aa1c5f213'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:35.764713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046d3c176330479e99bc839aa1c5f213'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:35.765391 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046d3c176330479e99bc839aa1c5f213'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:35.765986 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046d3c176330479e99bc839aa1c5f213'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:35.777273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046d3c176330479e99bc839aa1c5f213'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:35.789271 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 966/1949] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:35 2021] DELETE /identity/v3/users/046d3c176330479e99bc839aa1c5f213 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:35.793798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125ee4-d5af-47b3-8fe8-e86365753f7b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:35.794090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125ee4-d5af-47b3-8fe8-e86365753f7b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:35.794391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125ee4-d5af-47b3-8fe8-e86365753f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:35.811571 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-35125ee4-d5af-47b3-8fe8-e86365753f7b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:35.812772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-35125ee4-d5af-47b3-8fe8-e86365753f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:35.870042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 984/1950] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:35.879988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:35.881394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:35.941228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548cb254-3fdb-4f8c-99a4-d0e1f4349b7d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:35.946342 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d030bf0-ec74-40f9-b3f7-dbfa10fa4aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:35.947018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d030bf0-ec74-40f9-b3f7-dbfa10fa4aec service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:35.947302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d030bf0-ec74-40f9-b3f7-dbfa10fa4aec service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:35.948441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d030bf0-ec74-40f9-b3f7-dbfa10fa4aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:35.958599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d030bf0-ec74-40f9-b3f7-dbfa10fa4aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:35.960018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d030bf0-ec74-40f9-b3f7-dbfa10fa4aec service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:35.969605 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 967/1951] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:36.241744 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35125ee4-d5af-47b3-8fe8-e86365753f7b None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:36.244069 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-35125ee4-d5af-47b3-8fe8-e86365753f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:36.259899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35125ee4-d5af-47b3-8fe8-e86365753f7b None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:36.268471 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d030bf0-ec74-40f9-b3f7-dbfa10fa4aec service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:36.270311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-6d030bf0-ec74-40f9-b3f7-dbfa10fa4aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:36.281958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:36.284341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:36.285180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d030bf0-ec74-40f9-b3f7-dbfa10fa4aec service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:36.285315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:36.285861 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] PATH_INFO: `/v3/projects/56cc5206654a42b099c26d99bcfee94f` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:36.287569 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cc5206654a42b099c26d99bcfee94f)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:36.290229 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:36.293401 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf2bec-9e3e-40c3-83a6-c8fb6124e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:36.294548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf2bec-9e3e-40c3-83a6-c8fb6124e723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:36.294975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf2bec-9e3e-40c3-83a6-c8fb6124e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:36.295464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf2bec-9e3e-40c3-83a6-c8fb6124e723 admin admin] PATH_INFO: `/v3/users/8c8a3f588937423e80d8fdc24afb238a` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:36.297267 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf2bec-9e3e-40c3-83a6-c8fb6124e723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8a3f588937423e80d8fdc24afb238a)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:36.300125 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf2bec-9e3e-40c3-83a6-c8fb6124e723 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:36.348387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cc5206654a42b099c26d99bcfee94f', 'request_id': 'req-2416a361-de13-4a36-a885-8c96f88da949'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.356653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cc5206654a42b099c26d99bcfee94f', 'request_id': 'req-2416a361-de13-4a36-a885-8c96f88da949'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.364279 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cc5206654a42b099c26d99bcfee94f', 'request_id': 'req-2416a361-de13-4a36-a885-8c96f88da949'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.366279 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-69cf2bec-9e3e-40c3-83a6-c8fb6124e723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8a3f588937423e80d8fdc24afb238a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.373670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-69cf2bec-9e3e-40c3-83a6-c8fb6124e723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8a3f588937423e80d8fdc24afb238a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.374314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-69cf2bec-9e3e-40c3-83a6-c8fb6124e723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8a3f588937423e80d8fdc24afb238a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.374946 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-69cf2bec-9e3e-40c3-83a6-c8fb6124e723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8a3f588937423e80d8fdc24afb238a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.375806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] The token cache is being invalidate because project 56cc5206654a42b099c26d99bcfee94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:36.376099 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.376750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.378285 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 985/1952] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:36 2021] DELETE /identity/v3/projects/56cc5206654a42b099c26d99bcfee94f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:36.382077 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:36.383383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:36.387453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-69cf2bec-9e3e-40c3-83a6-c8fb6124e723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8a3f588937423e80d8fdc24afb238a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.401571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 968/1953] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:36 2021] DELETE /identity/v3/users/8c8a3f588937423e80d8fdc24afb238a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:36.406022 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66485225-3b11-4d07-8e10-2a9e662d5f4b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:36.406306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66485225-3b11-4d07-8e10-2a9e662d5f4b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:36.406611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66485225-3b11-4d07-8e10-2a9e662d5f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:36.423991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-66485225-3b11-4d07-8e10-2a9e662d5f4b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:36.425202 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-66485225-3b11-4d07-8e10-2a9e662d5f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:36.446985 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416a361-de13-4a36-a885-8c96f88da949 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:36.485554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 969/1954] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:36.495824 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66485225-3b11-4d07-8e10-2a9e662d5f4b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:36.497954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-66485225-3b11-4d07-8e10-2a9e662d5f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:36.506185 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:36.507311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:36.507725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:36.508005 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] PATH_INFO: `/v3/users/a8abcf0db1b24c0b8b3f254ff2718e7c` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:36.509285 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8abcf0db1b24c0b8b3f254ff2718e7c)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:36.516168 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:36.565013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66485225-3b11-4d07-8e10-2a9e662d5f4b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:36.569724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912180c-e36f-491f-a8fe-f62476a6af25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:36.570691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8abcf0db1b24c0b8b3f254ff2718e7c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.570893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912180c-e36f-491f-a8fe-f62476a6af25 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:36.571232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912180c-e36f-491f-a8fe-f62476a6af25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:36.571605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8abcf0db1b24c0b8b3f254ff2718e7c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.571779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912180c-e36f-491f-a8fe-f62476a6af25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:36.573859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f912180c-e36f-491f-a8fe-f62476a6af25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:36.579970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8abcf0db1b24c0b8b3f254ff2718e7c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.580826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8abcf0db1b24c0b8b3f254ff2718e7c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.591946 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912180c-e36f-491f-a8fe-f62476a6af25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:36.594070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912180c-e36f-491f-a8fe-f62476a6af25 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:36.598485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8abcf0db1b24c0b8b3f254ff2718e7c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:36.609081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 970/1955] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:36.615169 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 986/1956] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:36 2021] DELETE /identity/v3/users/a8abcf0db1b24c0b8b3f254ff2718e7c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:36.991037 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912180c-e36f-491f-a8fe-f62476a6af25 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:36.992588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f912180c-e36f-491f-a8fe-f62476a6af25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:36.997006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:36.998447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:37.004847 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912180c-e36f-491f-a8fe-f62476a6af25 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.069555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadea9f-e6df-43a5-b136-c7551aa6416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.070433 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadea9f-e6df-43a5-b136-c7551aa6416b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.070836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadea9f-e6df-43a5-b136-c7551aa6416b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.071248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadea9f-e6df-43a5-b136-c7551aa6416b admin admin] PATH_INFO: `/v3/projects/5ef475269dfd451fb26bfe4394ce7a89` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.073534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadea9f-e6df-43a5-b136-c7551aa6416b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ef475269dfd451fb26bfe4394ce7a89)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.076492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadea9f-e6df-43a5-b136-c7551aa6416b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:37.082750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d3e4-cba6-4ac4-96cf-16c76c26f3af admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.087534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.089089 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.089421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.089782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] PATH_INFO: `/v3/projects/9c2b3a985fe046f6b84dbbf2a5bd4c64` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.091035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2b3a985fe046f6b84dbbf2a5bd4c64)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.092928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:37.130600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4cadea9f-e6df-43a5-b136-c7551aa6416b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ef475269dfd451fb26bfe4394ce7a89', 'request_id': 'req-4cadea9f-e6df-43a5-b136-c7551aa6416b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.137013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4cadea9f-e6df-43a5-b136-c7551aa6416b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ef475269dfd451fb26bfe4394ce7a89', 'request_id': 'req-4cadea9f-e6df-43a5-b136-c7551aa6416b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.141938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2b3a985fe046f6b84dbbf2a5bd4c64', 'request_id': 'req-497ad269-4b97-443a-bb82-82668e6833bd'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.143596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4cadea9f-e6df-43a5-b136-c7551aa6416b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ef475269dfd451fb26bfe4394ce7a89', 'request_id': 'req-4cadea9f-e6df-43a5-b136-c7551aa6416b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.148590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2b3a985fe046f6b84dbbf2a5bd4c64', 'request_id': 'req-497ad269-4b97-443a-bb82-82668e6833bd'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.156775 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2b3a985fe046f6b84dbbf2a5bd4c64', 'request_id': 'req-497ad269-4b97-443a-bb82-82668e6833bd'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.159070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4cadea9f-e6df-43a5-b136-c7551aa6416b admin admin] The token cache is being invalidate because project 5ef475269dfd451fb26bfe4394ce7a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:37.159462 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4cadea9f-e6df-43a5-b136-c7551aa6416b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.160343 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4cadea9f-e6df-43a5-b136-c7551aa6416b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.162632 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 971/1957] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:36 2021] DELETE /identity/v3/projects/5ef475269dfd451fb26bfe4394ce7a89 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:37.168174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] The token cache is being invalidate because project 9c2b3a985fe046f6b84dbbf2a5bd4c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:37.168533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0b28d-02e0-45ef-aa02-92ac34beda36 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.168650 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.168822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0b28d-02e0-45ef-aa02-92ac34beda36 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.169097 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0b28d-02e0-45ef-aa02-92ac34beda36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.169222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.170788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 987/1958] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:36 2021] DELETE /identity/v3/projects/9c2b3a985fe046f6b84dbbf2a5bd4c64 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:37.174547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:37.175838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:37.187723 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-85e0b28d-02e0-45ef-aa02-92ac34beda36 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:37.188925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-85e0b28d-02e0-45ef-aa02-92ac34beda36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:37.240845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ad269-4b97-443a-bb82-82668e6833bd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.246656 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.247535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.247838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.248783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] PATH_INFO: `/v3/users/37d264b24c39474e99704fdd8567091f` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.250094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d264b24c39474e99704fdd8567091f)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.250373 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 972/1959] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:37.252102 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:37.258428 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8072-1cf6-4868-9656-b5eb1bb12a2a None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.258726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8072-1cf6-4868-9656-b5eb1bb12a2a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.259010 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8072-1cf6-4868-9656-b5eb1bb12a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.278951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-a4fd8072-1cf6-4868-9656-b5eb1bb12a2a None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:37.280641 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a4fd8072-1cf6-4868-9656-b5eb1bb12a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:37.289863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 973/1960] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:37.295104 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd8072-1cf6-4868-9656-b5eb1bb12a2a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:37.299568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d264b24c39474e99704fdd8567091f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.300232 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d264b24c39474e99704fdd8567091f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.304304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd8072-1cf6-4868-9656-b5eb1bb12a2a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.308287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d264b24c39474e99704fdd8567091f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.308287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d264b24c39474e99704fdd8567091f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.311038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e83b82-90fb-42aa-8a64-f0159549af8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.311880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e83b82-90fb-42aa-8a64-f0159549af8d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.312260 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e83b82-90fb-42aa-8a64-f0159549af8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.312728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e83b82-90fb-42aa-8a64-f0159549af8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.313660 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e83b82-90fb-42aa-8a64-f0159549af8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:37.314128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e83b82-90fb-42aa-8a64-f0159549af8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.316970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e83b82-90fb-42aa-8a64-f0159549af8d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:37.324383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d264b24c39474e99704fdd8567091f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.335592 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 974/1961] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 01:09:37.340752 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 988/1962] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:37 2021] DELETE /identity/v3/users/37d264b24c39474e99704fdd8567091f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:37.343636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e83b82-90fb-42aa-8a64-f0159549af8d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:37.345906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a5e83b82-90fb-42aa-8a64-f0159549af8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:37.363239 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e83b82-90fb-42aa-8a64-f0159549af8d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.440583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0c581-98ff-4491-91d8-e1bb6d51b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.441292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0c581-98ff-4491-91d8-e1bb6d51b00e admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.441612 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0c581-98ff-4491-91d8-e1bb6d51b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.441904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0c581-98ff-4491-91d8-e1bb6d51b00e admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.442920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0c581-98ff-4491-91d8-e1bb6d51b00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.444885 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0c581-98ff-4491-91d8-e1bb6d51b00e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:37.486171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 975/1963] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:37 2021] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:37.490899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:37.508433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bd701-3ef7-4e63-bab4-bad3210cc865 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.596339 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac34c9-57c0-4f20-b57a-b31e29de3909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.597444 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac34c9-57c0-4f20-b57a-b31e29de3909 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.597952 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac34c9-57c0-4f20-b57a-b31e29de3909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.598773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac34c9-57c0-4f20-b57a-b31e29de3909 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.599721 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac34c9-57c0-4f20-b57a-b31e29de3909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.603108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac34c9-57c0-4f20-b57a-b31e29de3909 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:37.629356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 989/1964] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:37 2021] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:37.634050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0c581-98ff-4491-91d8-e1bb6d51b00e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:37.646618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0c581-98ff-4491-91d8-e1bb6d51b00e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.654846 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683a89c-c17d-46d7-b67b-f2b651a5071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.655637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac34c9-57c0-4f20-b57a-b31e29de3909 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:37.657440 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-99ac34c9-57c0-4f20-b57a-b31e29de3909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:37.661108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683a89c-c17d-46d7-b67b-f2b651a5071a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.661776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683a89c-c17d-46d7-b67b-f2b651a5071a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.661776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683a89c-c17d-46d7-b67b-f2b651a5071a admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.662607 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683a89c-c17d-46d7-b67b-f2b651a5071a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.664262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683a89c-c17d-46d7-b67b-f2b651a5071a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:37.673530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac34c9-57c0-4f20-b57a-b31e29de3909 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.676223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 976/1965] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:37.680646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683a89c-c17d-46d7-b67b-f2b651a5071a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:37.681669 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c1d8f-1c24-4381-a860-7201fb8468b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.683227 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c1d8f-1c24-4381-a860-7201fb8468b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.683819 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c1d8f-1c24-4381-a860-7201fb8468b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.684192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c1d8f-1c24-4381-a860-7201fb8468b8 admin admin] PATH_INFO: `/v3/projects/a635295eb2c4470494fef4bd9cd9ded6` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.685586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c1d8f-1c24-4381-a860-7201fb8468b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a635295eb2c4470494fef4bd9cd9ded6)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.689163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c1d8f-1c24-4381-a860-7201fb8468b8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:37.694140 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683a89c-c17d-46d7-b67b-f2b651a5071a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.700327 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c92b4a-93cd-4566-8418-de0ea61e6c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.700999 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c92b4a-93cd-4566-8418-de0ea61e6c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.701271 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c92b4a-93cd-4566-8418-de0ea61e6c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.701548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c92b4a-93cd-4566-8418-de0ea61e6c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.702283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c92b4a-93cd-4566-8418-de0ea61e6c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.703979 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c92b4a-93cd-4566-8418-de0ea61e6c16 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:37.714242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 977/1966] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:09:37.718287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c92b4a-93cd-4566-8418-de0ea61e6c16 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:37.730253 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c92b4a-93cd-4566-8418-de0ea61e6c16 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.747572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a71c1d8f-1c24-4381-a860-7201fb8468b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a635295eb2c4470494fef4bd9cd9ded6', 'request_id': 'req-a71c1d8f-1c24-4381-a860-7201fb8468b8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.757117 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a71c1d8f-1c24-4381-a860-7201fb8468b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a635295eb2c4470494fef4bd9cd9ded6', 'request_id': 'req-a71c1d8f-1c24-4381-a860-7201fb8468b8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.766933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a71c1d8f-1c24-4381-a860-7201fb8468b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a635295eb2c4470494fef4bd9cd9ded6', 'request_id': 'req-a71c1d8f-1c24-4381-a860-7201fb8468b8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.779831 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a71c1d8f-1c24-4381-a860-7201fb8468b8 admin admin] The token cache is being invalidate because project a635295eb2c4470494fef4bd9cd9ded6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:37.780235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a71c1d8f-1c24-4381-a860-7201fb8468b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.780994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a71c1d8f-1c24-4381-a860-7201fb8468b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:37.782892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 990/1967] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:37 2021] DELETE /identity/v3/projects/a635295eb2c4470494fef4bd9cd9ded6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:37.791235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440afad-21e0-43b6-b71b-816c9e0f43f2 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.792063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440afad-21e0-43b6-b71b-816c9e0f43f2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.792342 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440afad-21e0-43b6-b71b-816c9e0f43f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.800048 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a879b-5b08-403c-b716-1d921656a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.800542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a879b-5b08-403c-b716-1d921656a716 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.800819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a879b-5b08-403c-b716-1d921656a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.801369 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a879b-5b08-403c-b716-1d921656a716 admin admin] PATH_INFO: `/v3/projects/ba69d4ccceab458694e29d79b83bbc0e/users/0cd655e766ef4affaba58a8344d68073/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.811234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-7440afad-21e0-43b6-b71b-816c9e0f43f2 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:37.812781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-7440afad-21e0-43b6-b71b-816c9e0f43f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:37.817201 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a879b-5b08-403c-b716-1d921656a716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba69d4ccceab458694e29d79b83bbc0e, user_id=0cd655e766ef4affaba58a8344d68073, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.819840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a879b-5b08-403c-b716-1d921656a716 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:37.822199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 991/1968] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:37.830892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50203c94-b203-4fff-a7f3-500641d7c4d6 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.831207 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50203c94-b203-4fff-a7f3-500641d7c4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.831463 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50203c94-b203-4fff-a7f3-500641d7c4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.836456 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 978/1969] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:37 2021] PUT /identity/v3/projects/ba69d4ccceab458694e29d79b83bbc0e/users/0cd655e766ef4affaba58a8344d68073/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:37.847290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e224131-8ff7-49d5-89fc-0c69e81045f9 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.847581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e224131-8ff7-49d5-89fc-0c69e81045f9 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.847863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e224131-8ff7-49d5-89fc-0c69e81045f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.852992 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-50203c94-b203-4fff-a7f3-500641d7c4d6 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:37.854786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-50203c94-b203-4fff-a7f3-500641d7c4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:37.875915 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-4e224131-8ff7-49d5-89fc-0c69e81045f9 None None] MFA Rules not processed for user `0cd655e766ef4affaba58a8344d68073`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:37.876806 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4e224131-8ff7-49d5-89fc-0c69e81045f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:37.915757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 992/1970] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:37.920520 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50203c94-b203-4fff-a7f3-500641d7c4d6 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:37.929176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50203c94-b203-4fff-a7f3-500641d7c4d6 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.934270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6870f-dd49-491c-b51c-b443f8cb470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.934963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6870f-dd49-491c-b51c-b443f8cb470a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.935251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6870f-dd49-491c-b51c-b443f8cb470a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.935532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6870f-dd49-491c-b51c-b443f8cb470a admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.936266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6870f-dd49-491c-b51c-b443f8cb470a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:37.936579 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6870f-dd49-491c-b51c-b443f8cb470a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.938174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6870f-dd49-491c-b51c-b443f8cb470a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:37.940501 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 979/1971] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:37 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:37.945126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e224131-8ff7-49d5-89fc-0c69e81045f9 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:37.947056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4e224131-8ff7-49d5-89fc-0c69e81045f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:37.950505 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 993/1972] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 01:09:37.954686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6870f-dd49-491c-b51c-b443f8cb470a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:37.964631 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6870f-dd49-491c-b51c-b443f8cb470a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.964838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e224131-8ff7-49d5-89fc-0c69e81045f9 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:37.969345 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea9725-96cf-403e-a80c-55bb232bea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.969582 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a8827-632b-4cd3-9b2e-3b0e0c257a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:37.969990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9725-96cf-403e-a80c-55bb232bea79 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.970268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9725-96cf-403e-a80c-55bb232bea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.970424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a8827-632b-4cd3-9b2e-3b0e0c257a1d admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:37.970830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9725-96cf-403e-a80c-55bb232bea79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.970956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a8827-632b-4cd3-9b2e-3b0e0c257a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:37.971214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a8827-632b-4cd3-9b2e-3b0e0c257a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:37.971522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea9725-96cf-403e-a80c-55bb232bea79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.972017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a8827-632b-4cd3-9b2e-3b0e0c257a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:37.973655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea9725-96cf-403e-a80c-55bb232bea79 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:37.973879 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a8827-632b-4cd3-9b2e-3b0e0c257a1d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.006449 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 994/1973] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:37 2021] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:38.007458 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a8827-632b-4cd3-9b2e-3b0e0c257a1d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:38.008008 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 980/1974] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:37 2021] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:38.012213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea9725-96cf-403e-a80c-55bb232bea79 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:38.070275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a8827-632b-4cd3-9b2e-3b0e0c257a1d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:38.075144 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03370a86-8a12-486d-8798-57a9dd14d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:38.075804 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03370a86-8a12-486d-8798-57a9dd14d265 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.076084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03370a86-8a12-486d-8798-57a9dd14d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.076360 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03370a86-8a12-486d-8798-57a9dd14d265 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.077059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03370a86-8a12-486d-8798-57a9dd14d265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:38.079003 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03370a86-8a12-486d-8798-57a9dd14d265 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.079335 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea9725-96cf-403e-a80c-55bb232bea79 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:38.083918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74e850-e129-40a3-bfa0-1f8112aa26f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:38.084576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74e850-e129-40a3-bfa0-1f8112aa26f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.084859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74e850-e129-40a3-bfa0-1f8112aa26f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.085163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74e850-e129-40a3-bfa0-1f8112aa26f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.085861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74e850-e129-40a3-bfa0-1f8112aa26f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:38.087787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74e850-e129-40a3-bfa0-1f8112aa26f8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.099143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 995/1975] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:38 2021] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:38.105602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03370a86-8a12-486d-8798-57a9dd14d265 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:38.109766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 981/1976] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:38 2021] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:38.113379 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74e850-e129-40a3-bfa0-1f8112aa26f8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:38.115496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03370a86-8a12-486d-8798-57a9dd14d265 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:38.120827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece47bd-a1b3-43ca-8bde-988053efdbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:38.121473 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece47bd-a1b3-43ca-8bde-988053efdbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.121752 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece47bd-a1b3-43ca-8bde-988053efdbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.122021 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece47bd-a1b3-43ca-8bde-988053efdbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.122793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece47bd-a1b3-43ca-8bde-988053efdbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:38.123324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74e850-e129-40a3-bfa0-1f8112aa26f8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:38.124377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece47bd-a1b3-43ca-8bde-988053efdbc8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.128089 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6a61-048e-4bfc-9279-e70d912eebda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:38.128798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6a61-048e-4bfc-9279-e70d912eebda admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.129089 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6a61-048e-4bfc-9279-e70d912eebda admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.129371 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6a61-048e-4bfc-9279-e70d912eebda admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.130108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a6a61-048e-4bfc-9279-e70d912eebda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:38.131721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a6a61-048e-4bfc-9279-e70d912eebda admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.134512 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 996/1977] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:09:38.138643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece47bd-a1b3-43ca-8bde-988053efdbc8 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:38.142884 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 982/1978] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:38 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:09:38.146812 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6a61-048e-4bfc-9279-e70d912eebda admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:38.148565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece47bd-a1b3-43ca-8bde-988053efdbc8 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:38.154173 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee57c3-6469-450d-ac5d-8b038870ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:38.154856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee57c3-6469-450d-ac5d-8b038870ea17 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.155166 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee57c3-6469-450d-ac5d-8b038870ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.155448 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee57c3-6469-450d-ac5d-8b038870ea17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.156176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee57c3-6469-450d-ac5d-8b038870ea17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:38.156315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6a61-048e-4bfc-9279-e70d912eebda admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:38.157763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee57c3-6469-450d-ac5d-8b038870ea17 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.160975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14782497-aa62-4bd7-8572-6de5c29e492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:38.161836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14782497-aa62-4bd7-8572-6de5c29e492f admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.162119 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14782497-aa62-4bd7-8572-6de5c29e492f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.162425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14782497-aa62-4bd7-8572-6de5c29e492f admin admin] PATH_INFO: `/v3/projects/491a3b7df8094d92a4efed87dc87f42a/users/77016684924b45f387de6db417c3b2eb/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.167947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 997/1979] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:38 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:09:38.171944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee57c3-6469-450d-ac5d-8b038870ea17 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:38.177810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14782497-aa62-4bd7-8572-6de5c29e492f admin admin] RBAC: Authorizing `identity:create_grant(project_id=491a3b7df8094d92a4efed87dc87f42a, user_id=77016684924b45f387de6db417c3b2eb, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:38.180590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14782497-aa62-4bd7-8572-6de5c29e492f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.181263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee57c3-6469-450d-ac5d-8b038870ea17 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:38.187512 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3df700-f759-4fbb-b5f3-8e04d0000758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:38.188640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3df700-f759-4fbb-b5f3-8e04d0000758 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.189036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3df700-f759-4fbb-b5f3-8e04d0000758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.189320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3df700-f759-4fbb-b5f3-8e04d0000758 admin admin] PATH_INFO: `/v3/projects/06c4ec42f14543b5ae58ba3b1da24dde/users/2af8ce4ede4048e49401c08fd0861a0d/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.198483 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 983/1980] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:38 2021] PUT /identity/v3/projects/491a3b7df8094d92a4efed87dc87f42a/users/77016684924b45f387de6db417c3b2eb/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:38.203361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14782497-aa62-4bd7-8572-6de5c29e492f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:38.205409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3df700-f759-4fbb-b5f3-8e04d0000758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c4ec42f14543b5ae58ba3b1da24dde, user_id=2af8ce4ede4048e49401c08fd0861a0d, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:38.208133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3df700-f759-4fbb-b5f3-8e04d0000758 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.224932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 998/1981] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:38 2021] PUT /identity/v3/projects/06c4ec42f14543b5ae58ba3b1da24dde/users/2af8ce4ede4048e49401c08fd0861a0d/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:38.235729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345b524-4dcf-4bec-986d-616c0d4cc748 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.236019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345b524-4dcf-4bec-986d-616c0d4cc748 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.236304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345b524-4dcf-4bec-986d-616c0d4cc748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.264042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-c345b524-4dcf-4bec-986d-616c0d4cc748 None None] MFA Rules not processed for user `2af8ce4ede4048e49401c08fd0861a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:38.265249 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c345b524-4dcf-4bec-986d-616c0d4cc748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:38.274845 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14782497-aa62-4bd7-8572-6de5c29e492f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:38.328388 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 999/1982] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:38 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:38.330323 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63dd4-ecc8-4ab2-aa0f-7c3ab52cef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:38.331021 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63dd4-ecc8-4ab2-aa0f-7c3ab52cef83 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.331302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63dd4-ecc8-4ab2-aa0f-7c3ab52cef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.331582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63dd4-ecc8-4ab2-aa0f-7c3ab52cef83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.332324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b63dd4-ecc8-4ab2-aa0f-7c3ab52cef83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:38.334039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b63dd4-ecc8-4ab2-aa0f-7c3ab52cef83 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.340211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345b524-4dcf-4bec-986d-616c0d4cc748 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:38.341601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c345b524-4dcf-4bec-986d-616c0d4cc748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:38.345039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 984/1983] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:38 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:09:38.349266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63dd4-ecc8-4ab2-aa0f-7c3ab52cef83 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:38.359378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63dd4-ecc8-4ab2-aa0f-7c3ab52cef83 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:38.364114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c4d4a-9a3a-4e88-b195-31f76bdc05e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:38.364983 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c4d4a-9a3a-4e88-b195-31f76bdc05e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.365267 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c4d4a-9a3a-4e88-b195-31f76bdc05e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.365550 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c4d4a-9a3a-4e88-b195-31f76bdc05e0 admin admin] PATH_INFO: `/v3/projects/491a3b7df8094d92a4efed87dc87f42a/users/77016684924b45f387de6db417c3b2eb/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.367854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c4d4a-9a3a-4e88-b195-31f76bdc05e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491a3b7df8094d92a4efed87dc87f42a, user_id=77016684924b45f387de6db417c3b2eb, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:38.371113 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c4d4a-9a3a-4e88-b195-31f76bdc05e0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.381569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 985/1984] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:38 2021] PUT /identity/v3/projects/491a3b7df8094d92a4efed87dc87f42a/users/77016684924b45f387de6db417c3b2eb/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:38.396647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdd778-d198-4a4e-bf05-c1c14de9ed2e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.396937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdd778-d198-4a4e-bf05-c1c14de9ed2e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.397218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdd778-d198-4a4e-bf05-c1c14de9ed2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.408129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345b524-4dcf-4bec-986d-616c0d4cc748 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:38.423383 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-97cdd778-d198-4a4e-bf05-c1c14de9ed2e None None] MFA Rules not processed for user `77016684924b45f387de6db417c3b2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:38.424582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-97cdd778-d198-4a4e-bf05-c1c14de9ed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:38.462942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffa826-32ba-4fb9-8333-ce4120c900be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d001733477f499e937ba90e7e50ba33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:38.463928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffa826-32ba-4fb9-8333-ce4120c900be service glance] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.464390 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffa826-32ba-4fb9-8333-ce4120c900be service glance] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.464830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffa826-32ba-4fb9-8333-ce4120c900be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.492141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 986/1985] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:38 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:38.499332 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdd778-d198-4a4e-bf05-c1c14de9ed2e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:38.524267 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffa826-32ba-4fb9-8333-ce4120c900be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:38.525877 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffa826-32ba-4fb9-8333-ce4120c900be service glance] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.535248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1000/1986] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:38 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:09:38.562481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdd778-d198-4a4e-bf05-c1c14de9ed2e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:38.567093 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:38.567964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.568251 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.568531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] PATH_INFO: `/v3/users/0cd655e766ef4affaba58a8344d68073` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.569755 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd655e766ef4affaba58a8344d68073)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:38.571702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.632581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd655e766ef4affaba58a8344d68073'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:38.641800 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd655e766ef4affaba58a8344d68073'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:38.642612 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd655e766ef4affaba58a8344d68073'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:38.643426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd655e766ef4affaba58a8344d68073'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:38.657228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd655e766ef4affaba58a8344d68073'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:38.678173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 987/1987] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:38 2021] DELETE /identity/v3/users/0cd655e766ef4affaba58a8344d68073 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:38.681412 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0470bb-975e-45a5-afb3-6970b16ffa58 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.681704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0470bb-975e-45a5-afb3-6970b16ffa58 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.682073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0470bb-975e-45a5-afb3-6970b16ffa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.704110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-7a0470bb-975e-45a5-afb3-6970b16ffa58 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:38.705513 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-7a0470bb-975e-45a5-afb3-6970b16ffa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:38.773338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1001/1988] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:38.784300 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:38.786520 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:38.847104 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f92320-43c4-4267-83ab-9c66eea5f22a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:38.850895 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932d698-9f50-4df0-b920-e8d44c72faf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:38.851605 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932d698-9f50-4df0-b920-e8d44c72faf8 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:38.851836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932d698-9f50-4df0-b920-e8d44c72faf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:38.852149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932d698-9f50-4df0-b920-e8d44c72faf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:38.862564 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932d698-9f50-4df0-b920-e8d44c72faf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:38.863980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932d698-9f50-4df0-b920-e8d44c72faf8 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:38.876656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 988/1989] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:39.196226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0470bb-975e-45a5-afb3-6970b16ffa58 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:39.198395 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-7a0470bb-975e-45a5-afb3-6970b16ffa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:39.211613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0470bb-975e-45a5-afb3-6970b16ffa58 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:39.217258 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:39.218126 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:39.218450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:39.218729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] PATH_INFO: `/v3/projects/ba69d4ccceab458694e29d79b83bbc0e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:39.220001 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba69d4ccceab458694e29d79b83bbc0e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:39.222199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:39.269105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba69d4ccceab458694e29d79b83bbc0e', 'request_id': 'req-3d4ec5d8-ec54-4475-8914-e265587a5a6f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:39.276611 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba69d4ccceab458694e29d79b83bbc0e', 'request_id': 'req-3d4ec5d8-ec54-4475-8914-e265587a5a6f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:39.285129 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba69d4ccceab458694e29d79b83bbc0e', 'request_id': 'req-3d4ec5d8-ec54-4475-8914-e265587a5a6f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:39.297648 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] The token cache is being invalidate because project ba69d4ccceab458694e29d79b83bbc0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:39.297938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:39.298611 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:39.302716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1002/1990] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:39 2021] DELETE /identity/v3/projects/ba69d4ccceab458694e29d79b83bbc0e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:39.304352 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932d698-9f50-4df0-b920-e8d44c72faf8 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:39.318023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932d698-9f50-4df0-b920-e8d44c72faf8 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:39.376610 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:39.377533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:39.377817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:39.378095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] PATH_INFO: `/v3/users/77016684924b45f387de6db417c3b2eb` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:39.379403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] RBAC: Authorizing `identity:delete_user(user_id=77016684924b45f387de6db417c3b2eb)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:39.381325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:39.429483 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77016684924b45f387de6db417c3b2eb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:39.438146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77016684924b45f387de6db417c3b2eb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:39.439486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77016684924b45f387de6db417c3b2eb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:39.440426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77016684924b45f387de6db417c3b2eb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:39.454961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77016684924b45f387de6db417c3b2eb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:39.476821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 989/1991] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:39 2021] DELETE /identity/v3/users/77016684924b45f387de6db417c3b2eb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:39.758136 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:39.759594 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:39.773759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ec5d8-ec54-4475-8914-e265587a5a6f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:39.858328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:39.864852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:39.913917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2ec66-df1c-4f78-8ad5-07918b605bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:39.917049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2ec66-df1c-4f78-8ad5-07918b605bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:39.917049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2ec66-df1c-4f78-8ad5-07918b605bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:39.917544 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2ec66-df1c-4f78-8ad5-07918b605bf6 admin admin] PATH_INFO: `/v3/projects/491a3b7df8094d92a4efed87dc87f42a` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:39.920499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2ec66-df1c-4f78-8ad5-07918b605bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491a3b7df8094d92a4efed87dc87f42a)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:39.924142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2ec66-df1c-4f78-8ad5-07918b605bf6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:39.956629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6092001-a30d-4e47-ad66-f1bbe640860f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:39.961914 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de132c55-59b4-4445-a3e6-844ef83a93c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:39.962843 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de132c55-59b4-4445-a3e6-844ef83a93c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:39.963411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de132c55-59b4-4445-a3e6-844ef83a93c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:39.964136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de132c55-59b4-4445-a3e6-844ef83a93c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:39.966848 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-de132c55-59b4-4445-a3e6-844ef83a93c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:40.004717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-64c2ec66-df1c-4f78-8ad5-07918b605bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491a3b7df8094d92a4efed87dc87f42a', 'request_id': 'req-64c2ec66-df1c-4f78-8ad5-07918b605bf6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:40.011576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-64c2ec66-df1c-4f78-8ad5-07918b605bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491a3b7df8094d92a4efed87dc87f42a', 'request_id': 'req-64c2ec66-df1c-4f78-8ad5-07918b605bf6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:40.020360 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-64c2ec66-df1c-4f78-8ad5-07918b605bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491a3b7df8094d92a4efed87dc87f42a', 'request_id': 'req-64c2ec66-df1c-4f78-8ad5-07918b605bf6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:40.038274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-64c2ec66-df1c-4f78-8ad5-07918b605bf6 admin admin] The token cache is being invalidate because project 491a3b7df8094d92a4efed87dc87f42a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:40.038807 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-64c2ec66-df1c-4f78-8ad5-07918b605bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:40.040878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-64c2ec66-df1c-4f78-8ad5-07918b605bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:40.046455 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1003/1992] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:39 2021] DELETE /identity/v3/projects/491a3b7df8094d92a4efed87dc87f42a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:40.050972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523cb73-83fb-4efb-8b01-7f618fb8c9ae None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.051397 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523cb73-83fb-4efb-8b01-7f618fb8c9ae None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.051666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523cb73-83fb-4efb-8b01-7f618fb8c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.052440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de132c55-59b4-4445-a3e6-844ef83a93c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:40.053959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de132c55-59b4-4445-a3e6-844ef83a93c7 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:40.069363 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 990/1993] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:39 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:40.075306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-c523cb73-83fb-4efb-8b01-7f618fb8c9ae None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:40.075306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c523cb73-83fb-4efb-8b01-7f618fb8c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:40.164994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1004/1994] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:40.179247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5a19b-4087-48f6-83c1-7b5f6840cd9c None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.179950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5a19b-4087-48f6-83c1-7b5f6840cd9c None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.180591 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5a19b-4087-48f6-83c1-7b5f6840cd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.209034 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-96d5a19b-4087-48f6-83c1-7b5f6840cd9c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:40.209034 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-96d5a19b-4087-48f6-83c1-7b5f6840cd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:40.217780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 991/1995] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:40.222599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523cb73-83fb-4efb-8b01-7f618fb8c9ae None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:40.233885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523cb73-83fb-4efb-8b01-7f618fb8c9ae None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:40.238708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542b6b4-92f0-44c3-9fe8-2893e770e18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:40.239359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542b6b4-92f0-44c3-9fe8-2893e770e18b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.239702 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542b6b4-92f0-44c3-9fe8-2893e770e18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.239982 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542b6b4-92f0-44c3-9fe8-2893e770e18b admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.240711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542b6b4-92f0-44c3-9fe8-2893e770e18b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:40.241017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542b6b4-92f0-44c3-9fe8-2893e770e18b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:40.242758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542b6b4-92f0-44c3-9fe8-2893e770e18b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:40.255805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1005/1996] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 01:09:40.260229 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5a19b-4087-48f6-83c1-7b5f6840cd9c None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:40.270690 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5a19b-4087-48f6-83c1-7b5f6840cd9c None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:40.275398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642030b-1c8e-4204-95b1-504c91768a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:40.276095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642030b-1c8e-4204-95b1-504c91768a92 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.276376 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642030b-1c8e-4204-95b1-504c91768a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.276630 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642030b-1c8e-4204-95b1-504c91768a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.277366 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642030b-1c8e-4204-95b1-504c91768a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:40.279281 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642030b-1c8e-4204-95b1-504c91768a92 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:40.306541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 992/1997] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:40 2021] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:40.314345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542b6b4-92f0-44c3-9fe8-2893e770e18b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:40.325210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542b6b4-92f0-44c3-9fe8-2893e770e18b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:40.380844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3fb4c-f574-47e3-9dbb-adf329a5031b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:40.381504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3fb4c-f574-47e3-9dbb-adf329a5031b admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.381784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3fb4c-f574-47e3-9dbb-adf329a5031b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.382053 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3fb4c-f574-47e3-9dbb-adf329a5031b admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.382869 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3fb4c-f574-47e3-9dbb-adf329a5031b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:40.384766 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3fb4c-f574-47e3-9dbb-adf329a5031b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:40.405320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1006/1998] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:40 2021] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:40.409315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642030b-1c8e-4204-95b1-504c91768a92 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:40.421009 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642030b-1c8e-4204-95b1-504c91768a92 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:40.428104 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f562aa-f2ff-4e33-88a7-a7ce827a8800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:40.429008 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f562aa-f2ff-4e33-88a7-a7ce827a8800 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.429400 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f562aa-f2ff-4e33-88a7-a7ce827a8800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.429780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f562aa-f2ff-4e33-88a7-a7ce827a8800 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.430879 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f562aa-f2ff-4e33-88a7-a7ce827a8800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:40.433708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f562aa-f2ff-4e33-88a7-a7ce827a8800 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:40.448557 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 993/1999] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:40 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:40.452902 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3fb4c-f574-47e3-9dbb-adf329a5031b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:40.466800 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3fb4c-f574-47e3-9dbb-adf329a5031b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:40.473302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea387de7-13bc-429a-92be-80f763fc5b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:40.474213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea387de7-13bc-429a-92be-80f763fc5b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.474639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea387de7-13bc-429a-92be-80f763fc5b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.475022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea387de7-13bc-429a-92be-80f763fc5b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.476073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea387de7-13bc-429a-92be-80f763fc5b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:40.478426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea387de7-13bc-429a-92be-80f763fc5b1c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:40.493446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1007/2000] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:40 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:40.499405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f562aa-f2ff-4e33-88a7-a7ce827a8800 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:40.509227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f562aa-f2ff-4e33-88a7-a7ce827a8800 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:40.514754 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09cfc5-b7e9-4853-ad31-d04bac9c9612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:40.515661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09cfc5-b7e9-4853-ad31-d04bac9c9612 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.515985 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09cfc5-b7e9-4853-ad31-d04bac9c9612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.516258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09cfc5-b7e9-4853-ad31-d04bac9c9612 admin admin] PATH_INFO: `/v3/projects/494f9e73eec5488f947ad2b484bc0a84/users/d65602719134413595dfbe6f0780e218/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.535272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09cfc5-b7e9-4853-ad31-d04bac9c9612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494f9e73eec5488f947ad2b484bc0a84, user_id=d65602719134413595dfbe6f0780e218, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:40.537883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09cfc5-b7e9-4853-ad31-d04bac9c9612 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:40.551467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 994/2001] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:40 2021] PUT /identity/v3/projects/494f9e73eec5488f947ad2b484bc0a84/users/d65602719134413595dfbe6f0780e218/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:40.562387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6a067-e62d-43be-849d-64afca6a720e None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.562687 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6a067-e62d-43be-849d-64afca6a720e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.562972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6a067-e62d-43be-849d-64afca6a720e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.590481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-0fc6a067-e62d-43be-849d-64afca6a720e None None] MFA Rules not processed for user `d65602719134413595dfbe6f0780e218`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:40.591740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0fc6a067-e62d-43be-849d-64afca6a720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:40.654500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1008/2002] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:40 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:40.659294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09cfc5-b7e9-4853-ad31-d04bac9c9612 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:40.721077 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09cfc5-b7e9-4853-ad31-d04bac9c9612 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:40.725644 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9331916-655d-46ae-98b0-d558dd4789cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:40.726334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9331916-655d-46ae-98b0-d558dd4789cb admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.726674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9331916-655d-46ae-98b0-d558dd4789cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.726951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9331916-655d-46ae-98b0-d558dd4789cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.727663 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9331916-655d-46ae-98b0-d558dd4789cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:40.730270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9331916-655d-46ae-98b0-d558dd4789cb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:40.758721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 995/2003] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:40 2021] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:40.763782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6a067-e62d-43be-849d-64afca6a720e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:40.774207 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6a067-e62d-43be-849d-64afca6a720e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:40.830151 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85603d9b-19ec-4ff6-937b-426baf205841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:40.831025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85603d9b-19ec-4ff6-937b-426baf205841 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.831334 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85603d9b-19ec-4ff6-937b-426baf205841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.831608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85603d9b-19ec-4ff6-937b-426baf205841 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.832317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85603d9b-19ec-4ff6-937b-426baf205841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:40.834278 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85603d9b-19ec-4ff6-937b-426baf205841 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:40.859454 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1009/2004] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:40 2021] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:40.863437 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9331916-655d-46ae-98b0-d558dd4789cb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:40.874518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9331916-655d-46ae-98b0-d558dd4789cb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:40.879179 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85401ae7-1bc7-4abb-9afc-6f8cc35c334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:40.879836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85401ae7-1bc7-4abb-9afc-6f8cc35c334a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.880121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85401ae7-1bc7-4abb-9afc-6f8cc35c334a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.880398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85401ae7-1bc7-4abb-9afc-6f8cc35c334a admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.881134 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85401ae7-1bc7-4abb-9afc-6f8cc35c334a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:40.882781 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85401ae7-1bc7-4abb-9afc-6f8cc35c334a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:40.894036 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 996/2005] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:40 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:40.898352 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85603d9b-19ec-4ff6-937b-426baf205841 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:40.908609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85603d9b-19ec-4ff6-937b-426baf205841 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:40.913211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df66714-393b-45bc-9374-1c0ea5df8305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:40.914092 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df66714-393b-45bc-9374-1c0ea5df8305 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:40.914395 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df66714-393b-45bc-9374-1c0ea5df8305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:40.914668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df66714-393b-45bc-9374-1c0ea5df8305 admin admin] PATH_INFO: `/v3/projects/498e3455d27f426eae85ccb709ca1d85/users/0a30c156cf114729acbb22ff11c931cf/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:40.929179 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df66714-393b-45bc-9374-1c0ea5df8305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498e3455d27f426eae85ccb709ca1d85, user_id=0a30c156cf114729acbb22ff11c931cf, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:40.932472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df66714-393b-45bc-9374-1c0ea5df8305 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:40.945077 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1010/2006] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:40 2021] PUT /identity/v3/projects/498e3455d27f426eae85ccb709ca1d85/users/0a30c156cf114729acbb22ff11c931cf/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:40.949831 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85401ae7-1bc7-4abb-9afc-6f8cc35c334a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:40.960095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85401ae7-1bc7-4abb-9afc-6f8cc35c334a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:41.021830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bad4f3-c06f-4860-bf8e-c422dcd20150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:41.022523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bad4f3-c06f-4860-bf8e-c422dcd20150 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:41.022805 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bad4f3-c06f-4860-bf8e-c422dcd20150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:41.023086 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bad4f3-c06f-4860-bf8e-c422dcd20150 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:41.023816 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bad4f3-c06f-4860-bf8e-c422dcd20150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:41.025995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bad4f3-c06f-4860-bf8e-c422dcd20150 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:41.036218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 997/2007] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:40 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:41.044209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df66714-393b-45bc-9374-1c0ea5df8305 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:41.054352 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df66714-393b-45bc-9374-1c0ea5df8305 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:41.059775 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc23e56-cd44-4aa2-9d76-765a0ccbd9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:41.060672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc23e56-cd44-4aa2-9d76-765a0ccbd9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:41.060948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc23e56-cd44-4aa2-9d76-765a0ccbd9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:41.061228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc23e56-cd44-4aa2-9d76-765a0ccbd9ec admin admin] PATH_INFO: `/v3/projects/498e3455d27f426eae85ccb709ca1d85/users/0a30c156cf114729acbb22ff11c931cf/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:41.063643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc23e56-cd44-4aa2-9d76-765a0ccbd9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=498e3455d27f426eae85ccb709ca1d85, user_id=0a30c156cf114729acbb22ff11c931cf, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:41.066299 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc23e56-cd44-4aa2-9d76-765a0ccbd9ec admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:41.077913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1011/2008] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:41 2021] PUT /identity/v3/projects/498e3455d27f426eae85ccb709ca1d85/users/0a30c156cf114729acbb22ff11c931cf/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:41.090088 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a693c-362b-456a-acec-14197892e6f7 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:41.090411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a693c-362b-456a-acec-14197892e6f7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:41.090732 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a693c-362b-456a-acec-14197892e6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:41.116816 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-ac0a693c-362b-456a-acec-14197892e6f7 None None] MFA Rules not processed for user `0a30c156cf114729acbb22ff11c931cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:41.118075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ac0a693c-362b-456a-acec-14197892e6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:41.193420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 998/2009] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:41 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:41.209016 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc23e56-cd44-4aa2-9d76-765a0ccbd9ec admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:41.211095 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2cc23e56-cd44-4aa2-9d76-765a0ccbd9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:41.274726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc23e56-cd44-4aa2-9d76-765a0ccbd9ec admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:41.278355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c98f0-58d7-4964-b1ca-98a9ffbd0540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:41.279095 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c98f0-58d7-4964-b1ca-98a9ffbd0540 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:41.279377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c98f0-58d7-4964-b1ca-98a9ffbd0540 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:41.279656 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c98f0-58d7-4964-b1ca-98a9ffbd0540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:41.288456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c98f0-58d7-4964-b1ca-98a9ffbd0540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:41.289874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c98f0-58d7-4964-b1ca-98a9ffbd0540 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:41.299743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1012/2010] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:41 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:42.630683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a693c-362b-456a-acec-14197892e6f7 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:42.692709 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a693c-362b-456a-acec-14197892e6f7 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:42.698286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:42.699192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:42.699483 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:42.699760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] PATH_INFO: `/v3/users/d65602719134413595dfbe6f0780e218` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:42.700987 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d65602719134413595dfbe6f0780e218)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:42.702950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:42.750618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd65602719134413595dfbe6f0780e218'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:42.757858 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd65602719134413595dfbe6f0780e218'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:42.758821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd65602719134413595dfbe6f0780e218'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:42.759538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd65602719134413595dfbe6f0780e218'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:42.773755 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd65602719134413595dfbe6f0780e218'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:42.786870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 999/2011] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:42 2021] DELETE /identity/v3/users/d65602719134413595dfbe6f0780e218 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:42.792370 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15d96a-1cac-46c6-8169-eb62e31d7124 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:42.792937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15d96a-1cac-46c6-8169-eb62e31d7124 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:42.792937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15d96a-1cac-46c6-8169-eb62e31d7124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:42.810947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-fc15d96a-1cac-46c6-8169-eb62e31d7124 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:42.812110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fc15d96a-1cac-46c6-8169-eb62e31d7124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:42.871862 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1013/2012] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:42.881729 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:42.883218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:42.941160 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4c695-974d-4c90-b7f4-417c6bfdf439 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:42.944972 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02543564-2ba3-4883-ac71-70e7933bede7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:42.945614 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02543564-2ba3-4883-ac71-70e7933bede7 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:42.945893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02543564-2ba3-4883-ac71-70e7933bede7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:42.946167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02543564-2ba3-4883-ac71-70e7933bede7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:42.955598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02543564-2ba3-4883-ac71-70e7933bede7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:42.957115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02543564-2ba3-4883-ac71-70e7933bede7 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:42.967346 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1000/2013] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:43.253499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15d96a-1cac-46c6-8169-eb62e31d7124 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:43.254922 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fc15d96a-1cac-46c6-8169-eb62e31d7124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:43.268091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15d96a-1cac-46c6-8169-eb62e31d7124 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:43.275355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:43.277032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:43.277599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:43.277599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] PATH_INFO: `/v3/projects/494f9e73eec5488f947ad2b484bc0a84` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:43.278980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494f9e73eec5488f947ad2b484bc0a84)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:43.280896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:43.330340 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494f9e73eec5488f947ad2b484bc0a84', 'request_id': 'req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.336213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494f9e73eec5488f947ad2b484bc0a84', 'request_id': 'req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.347392 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494f9e73eec5488f947ad2b484bc0a84', 'request_id': 'req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.359260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] The token cache is being invalidate because project 494f9e73eec5488f947ad2b484bc0a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:43.359554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.360214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.361754 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1014/2014] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:43 2021] DELETE /identity/v3/projects/494f9e73eec5488f947ad2b484bc0a84 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:43.366058 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02543564-2ba3-4883-ac71-70e7933bede7 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:43.376180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02543564-2ba3-4883-ac71-70e7933bede7 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:43.434888 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54191e6f-eaed-474a-88b8-013439ec46fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:43.435749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54191e6f-eaed-474a-88b8-013439ec46fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:43.436035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54191e6f-eaed-474a-88b8-013439ec46fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:43.436313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54191e6f-eaed-474a-88b8-013439ec46fe admin admin] PATH_INFO: `/v3/users/0a30c156cf114729acbb22ff11c931cf` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:43.437513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54191e6f-eaed-474a-88b8-013439ec46fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a30c156cf114729acbb22ff11c931cf)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:43.439823 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54191e6f-eaed-474a-88b8-013439ec46fe admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:43.492265 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-54191e6f-eaed-474a-88b8-013439ec46fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a30c156cf114729acbb22ff11c931cf'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.500032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-54191e6f-eaed-474a-88b8-013439ec46fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a30c156cf114729acbb22ff11c931cf'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.500736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-54191e6f-eaed-474a-88b8-013439ec46fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a30c156cf114729acbb22ff11c931cf'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.501456 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-54191e6f-eaed-474a-88b8-013439ec46fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a30c156cf114729acbb22ff11c931cf'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.514482 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-54191e6f-eaed-474a-88b8-013439ec46fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a30c156cf114729acbb22ff11c931cf'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.528795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1001/2015] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:43 2021] DELETE /identity/v3/users/0a30c156cf114729acbb22ff11c931cf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:43.803973 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:43.805592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:43.819906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5a37c-7c52-4d75-abc3-0aeaf2a16d64 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:43.881220 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450aea12-316d-42ab-a769-8e3617460e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:43.882171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aea12-316d-42ab-a769-8e3617460e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:43.882563 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aea12-316d-42ab-a769-8e3617460e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:43.882916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aea12-316d-42ab-a769-8e3617460e25 admin admin] PATH_INFO: `/v3/projects/498e3455d27f426eae85ccb709ca1d85` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:43.884352 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450aea12-316d-42ab-a769-8e3617460e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498e3455d27f426eae85ccb709ca1d85)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:43.886638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450aea12-316d-42ab-a769-8e3617460e25 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:43.938535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-450aea12-316d-42ab-a769-8e3617460e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498e3455d27f426eae85ccb709ca1d85', 'request_id': 'req-450aea12-316d-42ab-a769-8e3617460e25'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.944668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-450aea12-316d-42ab-a769-8e3617460e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498e3455d27f426eae85ccb709ca1d85', 'request_id': 'req-450aea12-316d-42ab-a769-8e3617460e25'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.952189 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-450aea12-316d-42ab-a769-8e3617460e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498e3455d27f426eae85ccb709ca1d85', 'request_id': 'req-450aea12-316d-42ab-a769-8e3617460e25'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.964297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-450aea12-316d-42ab-a769-8e3617460e25 admin admin] The token cache is being invalidate because project 498e3455d27f426eae85ccb709ca1d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:43.964619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-450aea12-316d-42ab-a769-8e3617460e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.965765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-450aea12-316d-42ab-a769-8e3617460e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:43.967504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1015/2016] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:43 2021] DELETE /identity/v3/projects/498e3455d27f426eae85ccb709ca1d85 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:43.973802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41012e-7ec5-48f4-b435-d0a801a4f815 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:43.974284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41012e-7ec5-48f4-b435-d0a801a4f815 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:43.974405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41012e-7ec5-48f4-b435-d0a801a4f815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:43.993715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-4b41012e-7ec5-48f4-b435-d0a801a4f815 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:43.995988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4b41012e-7ec5-48f4-b435-d0a801a4f815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:44.055818 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1002/2017] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:44.064019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb9a7f-b3a8-42bf-917d-954e8ad4ca77 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:44.064322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb9a7f-b3a8-42bf-917d-954e8ad4ca77 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:44.064602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb9a7f-b3a8-42bf-917d-954e8ad4ca77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:44.083371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9fcb9a7f-b3a8-42bf-917d-954e8ad4ca77 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:44.084507 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9fcb9a7f-b3a8-42bf-917d-954e8ad4ca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:44.092588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1016/2018] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:44.096989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41012e-7ec5-48f4-b435-d0a801a4f815 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:44.107093 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41012e-7ec5-48f4-b435-d0a801a4f815 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:44.111832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4c298-b712-4efc-be28-d66f8790ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:44.112493 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4c298-b712-4efc-be28-d66f8790ce91 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:44.112853 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4c298-b712-4efc-be28-d66f8790ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:44.113139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4c298-b712-4efc-be28-d66f8790ce91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:44.113904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4c298-b712-4efc-be28-d66f8790ce91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:44.114213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4c298-b712-4efc-be28-d66f8790ce91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:44.115880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4c298-b712-4efc-be28-d66f8790ce91 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:44.128074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1003/2019] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:09:44.132519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb9a7f-b3a8-42bf-917d-954e8ad4ca77 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:44.142201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb9a7f-b3a8-42bf-917d-954e8ad4ca77 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:44.146955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b188c8-03b0-4316-bf4d-a9e04dd1f066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:44.147623 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b188c8-03b0-4316-bf4d-a9e04dd1f066 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:44.147912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b188c8-03b0-4316-bf4d-a9e04dd1f066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:44.148208 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b188c8-03b0-4316-bf4d-a9e04dd1f066 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:44.148915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b188c8-03b0-4316-bf4d-a9e04dd1f066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:44.150907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b188c8-03b0-4316-bf4d-a9e04dd1f066 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:44.183705 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1017/2020] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:44 2021] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:44.184648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4c298-b712-4efc-be28-d66f8790ce91 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:44.194640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4c298-b712-4efc-be28-d66f8790ce91 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:44.254803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e049f5-0b63-4862-9914-755d30cc0cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:44.255475 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e049f5-0b63-4862-9914-755d30cc0cdd admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:44.255761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e049f5-0b63-4862-9914-755d30cc0cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:44.256039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e049f5-0b63-4862-9914-755d30cc0cdd admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:44.256764 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e049f5-0b63-4862-9914-755d30cc0cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:44.258713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e049f5-0b63-4862-9914-755d30cc0cdd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:44.279642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1004/2021] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:44 2021] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:44.283748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b188c8-03b0-4316-bf4d-a9e04dd1f066 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:44.295019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b188c8-03b0-4316-bf4d-a9e04dd1f066 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:44.299919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02a8f7-2097-49a8-8f36-7dafc0eed13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:44.300579 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02a8f7-2097-49a8-8f36-7dafc0eed13a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:44.300863 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02a8f7-2097-49a8-8f36-7dafc0eed13a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:44.301139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02a8f7-2097-49a8-8f36-7dafc0eed13a admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:44.301894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02a8f7-2097-49a8-8f36-7dafc0eed13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:44.303559 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02a8f7-2097-49a8-8f36-7dafc0eed13a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:44.316588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1018/2022] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:44.317970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e049f5-0b63-4862-9914-755d30cc0cdd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:44.328389 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e049f5-0b63-4862-9914-755d30cc0cdd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:44.334929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def36c9-5183-403a-8584-a414158fc2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:44.335792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def36c9-5183-403a-8584-a414158fc2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:44.336307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def36c9-5183-403a-8584-a414158fc2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:44.336854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def36c9-5183-403a-8584-a414158fc2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:44.338882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def36c9-5183-403a-8584-a414158fc2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:44.341122 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def36c9-5183-403a-8584-a414158fc2c8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:44.353244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1005/2023] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:44 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:44.357742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02a8f7-2097-49a8-8f36-7dafc0eed13a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:44.368570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02a8f7-2097-49a8-8f36-7dafc0eed13a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:44.375054 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986b70f-3162-4c8f-9f8a-1eb2db8374ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:44.376023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986b70f-3162-4c8f-9f8a-1eb2db8374ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:44.376295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986b70f-3162-4c8f-9f8a-1eb2db8374ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:44.376573 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986b70f-3162-4c8f-9f8a-1eb2db8374ed admin admin] PATH_INFO: `/v3/projects/32b0919f9cc94162a172e62ec5d3bbd4/users/0370c7a4973446cea164e4989000884d/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:44.392166 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986b70f-3162-4c8f-9f8a-1eb2db8374ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b0919f9cc94162a172e62ec5d3bbd4, user_id=0370c7a4973446cea164e4989000884d, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:44.395022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986b70f-3162-4c8f-9f8a-1eb2db8374ed admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:44.409083 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1019/2024] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:44 2021] PUT /identity/v3/projects/32b0919f9cc94162a172e62ec5d3bbd4/users/0370c7a4973446cea164e4989000884d/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:44.420688 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd00e64-e6b9-487d-902b-53d8f91bd90a None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:44.420974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd00e64-e6b9-487d-902b-53d8f91bd90a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:44.421277 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd00e64-e6b9-487d-902b-53d8f91bd90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:44.451565 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-4dd00e64-e6b9-487d-902b-53d8f91bd90a None None] MFA Rules not processed for user `0370c7a4973446cea164e4989000884d`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:44.452803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4dd00e64-e6b9-487d-902b-53d8f91bd90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:44.532039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1006/2025] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:44 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:44.536112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986b70f-3162-4c8f-9f8a-1eb2db8374ed admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:44.620544 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986b70f-3162-4c8f-9f8a-1eb2db8374ed admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:44.625912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee41ec-cef2-461e-b4f5-ef78e10c0437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:44.626647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee41ec-cef2-461e-b4f5-ef78e10c0437 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:44.626932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee41ec-cef2-461e-b4f5-ef78e10c0437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:44.627213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee41ec-cef2-461e-b4f5-ef78e10c0437 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:44.627989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee41ec-cef2-461e-b4f5-ef78e10c0437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:44.630017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee41ec-cef2-461e-b4f5-ef78e10c0437 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:44.692262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1020/2026] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:44 2021] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:44.696303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd00e64-e6b9-487d-902b-53d8f91bd90a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:44.724930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd00e64-e6b9-487d-902b-53d8f91bd90a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:44.813822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfba28-077d-4ce0-a90d-6e271a3ddf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:44.814643 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfba28-077d-4ce0-a90d-6e271a3ddf68 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:44.814925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfba28-077d-4ce0-a90d-6e271a3ddf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:44.815200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfba28-077d-4ce0-a90d-6e271a3ddf68 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:44.815903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfba28-077d-4ce0-a90d-6e271a3ddf68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:44.818302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfba28-077d-4ce0-a90d-6e271a3ddf68 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:44.842550 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1007/2027] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:44 2021] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:44.847117 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee41ec-cef2-461e-b4f5-ef78e10c0437 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:44.862885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee41ec-cef2-461e-b4f5-ef78e10c0437 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:44.868741 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ea5f8-1733-4c6f-b825-1831452532c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:44.870204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ea5f8-1733-4c6f-b825-1831452532c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:44.870675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ea5f8-1733-4c6f-b825-1831452532c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:44.871272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ea5f8-1733-4c6f-b825-1831452532c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:44.872163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ea5f8-1733-4c6f-b825-1831452532c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:44.874749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ea5f8-1733-4c6f-b825-1831452532c2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:44.888760 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1021/2028] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:44 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:44.893629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfba28-077d-4ce0-a90d-6e271a3ddf68 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:44.906822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfba28-077d-4ce0-a90d-6e271a3ddf68 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:44.912136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397d3c3-05e6-4d34-b704-24affd171439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:44.913176 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d3c3-05e6-4d34-b704-24affd171439 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:44.913415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d3c3-05e6-4d34-b704-24affd171439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:44.913697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d3c3-05e6-4d34-b704-24affd171439 admin admin] PATH_INFO: `/v3/projects/88b741ea62c44b83b20e0cdbe0810959/users/5198b4f74c9e4e158de3a29c07dea43a/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:44.933858 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397d3c3-05e6-4d34-b704-24affd171439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b741ea62c44b83b20e0cdbe0810959, user_id=5198b4f74c9e4e158de3a29c07dea43a, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:44.937183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397d3c3-05e6-4d34-b704-24affd171439 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:44.953352 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1008/2029] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:44 2021] PUT /identity/v3/projects/88b741ea62c44b83b20e0cdbe0810959/users/5198b4f74c9e4e158de3a29c07dea43a/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:44.957315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ea5f8-1733-4c6f-b825-1831452532c2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:44.969098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ea5f8-1733-4c6f-b825-1831452532c2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:45.041567 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4943fc6-3d0f-4dcf-b4c7-957a69c8ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:45.042487 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943fc6-3d0f-4dcf-b4c7-957a69c8ac7c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:45.042743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943fc6-3d0f-4dcf-b4c7-957a69c8ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:45.043115 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943fc6-3d0f-4dcf-b4c7-957a69c8ac7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:45.043869 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4943fc6-3d0f-4dcf-b4c7-957a69c8ac7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:45.045442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4943fc6-3d0f-4dcf-b4c7-957a69c8ac7c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:45.059135 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1022/2030] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:44 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:45.060273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397d3c3-05e6-4d34-b704-24affd171439 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:45.071346 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397d3c3-05e6-4d34-b704-24affd171439 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:45.077851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008d9d2-958a-4bb4-bf67-298fa2399b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:45.078773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008d9d2-958a-4bb4-bf67-298fa2399b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:45.079668 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008d9d2-958a-4bb4-bf67-298fa2399b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:45.079954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008d9d2-958a-4bb4-bf67-298fa2399b07 admin admin] PATH_INFO: `/v3/projects/88b741ea62c44b83b20e0cdbe0810959/users/5198b4f74c9e4e158de3a29c07dea43a/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:45.081914 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008d9d2-958a-4bb4-bf67-298fa2399b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b741ea62c44b83b20e0cdbe0810959, user_id=5198b4f74c9e4e158de3a29c07dea43a, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:45.084553 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008d9d2-958a-4bb4-bf67-298fa2399b07 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:45.096426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1009/2031] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:45 2021] PUT /identity/v3/projects/88b741ea62c44b83b20e0cdbe0810959/users/5198b4f74c9e4e158de3a29c07dea43a/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:45.110659 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e63d6d-1720-461c-a9cc-aecff148e6af None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:45.110945 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e63d6d-1720-461c-a9cc-aecff148e6af None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:45.111219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e63d6d-1720-461c-a9cc-aecff148e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:45.143806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-73e63d6d-1720-461c-a9cc-aecff148e6af None None] MFA Rules not processed for user `5198b4f74c9e4e158de3a29c07dea43a`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:45.145038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-73e63d6d-1720-461c-a9cc-aecff148e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:45.217631 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1023/2032] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:45 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:45.282773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008d9d2-958a-4bb4-bf67-298fa2399b07 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:45.284538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f008d9d2-958a-4bb4-bf67-298fa2399b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:45.349032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008d9d2-958a-4bb4-bf67-298fa2399b07 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:45.352711 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9ab5f-0dc0-4f01-a622-b90e27cb4cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:45.353349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9ab5f-0dc0-4f01-a622-b90e27cb4cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:45.353704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9ab5f-0dc0-4f01-a622-b90e27cb4cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:45.354006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9ab5f-0dc0-4f01-a622-b90e27cb4cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:45.363426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9ab5f-0dc0-4f01-a622-b90e27cb4cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:45.364973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9ab5f-0dc0-4f01-a622-b90e27cb4cb2 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:45.375896 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1010/2033] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:45 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:45.561800 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e63d6d-1720-461c-a9cc-aecff148e6af None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:45.632953 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e63d6d-1720-461c-a9cc-aecff148e6af None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:45.639667 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:45.640629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:45.640915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:45.641191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] PATH_INFO: `/v3/users/0370c7a4973446cea164e4989000884d` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:45.642926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0370c7a4973446cea164e4989000884d)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:45.645518 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:45.723429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0370c7a4973446cea164e4989000884d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:45.724100 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0370c7a4973446cea164e4989000884d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:45.732219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0370c7a4973446cea164e4989000884d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:45.732916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0370c7a4973446cea164e4989000884d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:45.746047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0370c7a4973446cea164e4989000884d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:45.764226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1024/2034] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:45 2021] DELETE /identity/v3/users/0370c7a4973446cea164e4989000884d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:45.765817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff2ab5-2383-445b-b180-d3c43478d728 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:45.766165 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff2ab5-2383-445b-b180-d3c43478d728 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:45.766528 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff2ab5-2383-445b-b180-d3c43478d728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:45.793955 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-75ff2ab5-2383-445b-b180-d3c43478d728 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:45.795567 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-75ff2ab5-2383-445b-b180-d3c43478d728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:45.877125 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1011/2035] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:45.887710 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:45.889493 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:45.952854 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ee4f5-da63-4d22-999c-88e32f012539 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:45.956827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbc580-d518-4170-ba28-1c183d7ef4dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:45.957477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbc580-d518-4170-ba28-1c183d7ef4dd service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:45.957761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbc580-d518-4170-ba28-1c183d7ef4dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:45.958036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbc580-d518-4170-ba28-1c183d7ef4dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:45.969565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbc580-d518-4170-ba28-1c183d7ef4dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:45.971438 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbc580-d518-4170-ba28-1c183d7ef4dd service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:45.984794 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1025/2036] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:46.313277 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff2ab5-2383-445b-b180-d3c43478d728 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:46.315023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-75ff2ab5-2383-445b-b180-d3c43478d728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:46.332444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff2ab5-2383-445b-b180-d3c43478d728 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:46.337651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:46.338576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:46.338975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:46.339326 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] PATH_INFO: `/v3/projects/32b0919f9cc94162a172e62ec5d3bbd4` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:46.340424 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b0919f9cc94162a172e62ec5d3bbd4)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:46.342316 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:46.391325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b0919f9cc94162a172e62ec5d3bbd4', 'request_id': 'req-29d03604-5663-441a-a9b6-982c2932c09e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:46.396590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b0919f9cc94162a172e62ec5d3bbd4', 'request_id': 'req-29d03604-5663-441a-a9b6-982c2932c09e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:46.403015 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b0919f9cc94162a172e62ec5d3bbd4', 'request_id': 'req-29d03604-5663-441a-a9b6-982c2932c09e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:46.414974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] The token cache is being invalidate because project 32b0919f9cc94162a172e62ec5d3bbd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:46.415269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:46.415865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:46.417408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1012/2037] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:46 2021] DELETE /identity/v3/projects/32b0919f9cc94162a172e62ec5d3bbd4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:46.421535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbc580-d518-4170-ba28-1c183d7ef4dd service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:46.432117 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbc580-d518-4170-ba28-1c183d7ef4dd service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:46.487651 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f564cb8-1772-47b6-ab49-22d10bb95446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:46.488504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f564cb8-1772-47b6-ab49-22d10bb95446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:46.488805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f564cb8-1772-47b6-ab49-22d10bb95446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:46.489231 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f564cb8-1772-47b6-ab49-22d10bb95446 admin admin] PATH_INFO: `/v3/users/5198b4f74c9e4e158de3a29c07dea43a` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:46.490770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f564cb8-1772-47b6-ab49-22d10bb95446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5198b4f74c9e4e158de3a29c07dea43a)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:46.492818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f564cb8-1772-47b6-ab49-22d10bb95446 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:46.539917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1f564cb8-1772-47b6-ab49-22d10bb95446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5198b4f74c9e4e158de3a29c07dea43a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:46.540603 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1f564cb8-1772-47b6-ab49-22d10bb95446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5198b4f74c9e4e158de3a29c07dea43a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:46.547887 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1f564cb8-1772-47b6-ab49-22d10bb95446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5198b4f74c9e4e158de3a29c07dea43a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:46.548647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1f564cb8-1772-47b6-ab49-22d10bb95446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5198b4f74c9e4e158de3a29c07dea43a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:46.561972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1f564cb8-1772-47b6-ab49-22d10bb95446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5198b4f74c9e4e158de3a29c07dea43a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:46.576091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1026/2038] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:46 2021] DELETE /identity/v3/users/5198b4f74c9e4e158de3a29c07dea43a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:46.845216 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:46.847189 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:46.868126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d03604-5663-441a-a9b6-982c2932c09e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:46.938380 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11753aff-510c-4f9e-9125-11bc1a16b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:46.939359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11753aff-510c-4f9e-9125-11bc1a16b3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:46.939709 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11753aff-510c-4f9e-9125-11bc1a16b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:46.940057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11753aff-510c-4f9e-9125-11bc1a16b3d0 admin admin] PATH_INFO: `/v3/projects/88b741ea62c44b83b20e0cdbe0810959` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:46.941360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11753aff-510c-4f9e-9125-11bc1a16b3d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b741ea62c44b83b20e0cdbe0810959)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:46.943590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11753aff-510c-4f9e-9125-11bc1a16b3d0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:47.001172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-11753aff-510c-4f9e-9125-11bc1a16b3d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b741ea62c44b83b20e0cdbe0810959', 'request_id': 'req-11753aff-510c-4f9e-9125-11bc1a16b3d0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:47.008704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-11753aff-510c-4f9e-9125-11bc1a16b3d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b741ea62c44b83b20e0cdbe0810959', 'request_id': 'req-11753aff-510c-4f9e-9125-11bc1a16b3d0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:47.024485 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-11753aff-510c-4f9e-9125-11bc1a16b3d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b741ea62c44b83b20e0cdbe0810959', 'request_id': 'req-11753aff-510c-4f9e-9125-11bc1a16b3d0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:47.042435 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-11753aff-510c-4f9e-9125-11bc1a16b3d0 admin admin] The token cache is being invalidate because project 88b741ea62c44b83b20e0cdbe0810959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:47.042729 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-11753aff-510c-4f9e-9125-11bc1a16b3d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:47.043438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-11753aff-510c-4f9e-9125-11bc1a16b3d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:47.045622 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1013/2039] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:46 2021] DELETE /identity/v3/projects/88b741ea62c44b83b20e0cdbe0810959 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:47.051401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66957fd7-9fe0-4ad6-9545-df726b94d041 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.051920 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66957fd7-9fe0-4ad6-9545-df726b94d041 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.052046 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66957fd7-9fe0-4ad6-9545-df726b94d041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.070398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-66957fd7-9fe0-4ad6-9545-df726b94d041 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:47.071585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-66957fd7-9fe0-4ad6-9545-df726b94d041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:47.130418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1027/2040] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:47.139129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21293-2bd5-4d1b-84b3-326991bb9f64 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.139416 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21293-2bd5-4d1b-84b3-326991bb9f64 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.139693 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21293-2bd5-4d1b-84b3-326991bb9f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.159758 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-39a21293-2bd5-4d1b-84b3-326991bb9f64 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:47.160899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-39a21293-2bd5-4d1b-84b3-326991bb9f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:47.170222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1014/2041] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:47.174633 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66957fd7-9fe0-4ad6-9545-df726b94d041 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:47.185179 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66957fd7-9fe0-4ad6-9545-df726b94d041 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:47.189941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55f9ff-f8fc-47bd-ac2a-ee7d13f946b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:47.190627 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55f9ff-f8fc-47bd-ac2a-ee7d13f946b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.191045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55f9ff-f8fc-47bd-ac2a-ee7d13f946b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.191329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55f9ff-f8fc-47bd-ac2a-ee7d13f946b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.192067 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55f9ff-f8fc-47bd-ac2a-ee7d13f946b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:47.192378 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55f9ff-f8fc-47bd-ac2a-ee7d13f946b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:47.193975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55f9ff-f8fc-47bd-ac2a-ee7d13f946b5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:47.206583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1028/2042] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:09:47.211726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a21293-2bd5-4d1b-84b3-326991bb9f64 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:47.221859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a21293-2bd5-4d1b-84b3-326991bb9f64 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:47.227160 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46673f-b25e-410e-831d-8eb74fb98109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:47.227813 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46673f-b25e-410e-831d-8eb74fb98109 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.228102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46673f-b25e-410e-831d-8eb74fb98109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.228395 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46673f-b25e-410e-831d-8eb74fb98109 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.229647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46673f-b25e-410e-831d-8eb74fb98109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:47.231738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46673f-b25e-410e-831d-8eb74fb98109 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:47.263547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1015/2043] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:47 2021] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:47.272775 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55f9ff-f8fc-47bd-ac2a-ee7d13f946b5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:47.284251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55f9ff-f8fc-47bd-ac2a-ee7d13f946b5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:47.344099 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3ef4b-1dbd-4307-b168-490e9a919e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:47.344782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3ef4b-1dbd-4307-b168-490e9a919e62 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.345068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3ef4b-1dbd-4307-b168-490e9a919e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.345600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3ef4b-1dbd-4307-b168-490e9a919e62 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.346322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3ef4b-1dbd-4307-b168-490e9a919e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:47.348314 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3ef4b-1dbd-4307-b168-490e9a919e62 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:47.370250 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1029/2044] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:47 2021] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:47.376168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46673f-b25e-410e-831d-8eb74fb98109 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:47.388386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46673f-b25e-410e-831d-8eb74fb98109 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:47.395745 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864090e-314b-4d72-8812-97ce57e226d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:47.396533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864090e-314b-4d72-8812-97ce57e226d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.396869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864090e-314b-4d72-8812-97ce57e226d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.397133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864090e-314b-4d72-8812-97ce57e226d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.397904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864090e-314b-4d72-8812-97ce57e226d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:47.399824 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864090e-314b-4d72-8812-97ce57e226d5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:47.413013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1016/2045] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:47 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:47.417629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3ef4b-1dbd-4307-b168-490e9a919e62 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:47.430390 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3ef4b-1dbd-4307-b168-490e9a919e62 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:47.436660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6cb90-c84c-4245-b6e2-af458f3ab2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:47.437327 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6cb90-c84c-4245-b6e2-af458f3ab2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.437612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6cb90-c84c-4245-b6e2-af458f3ab2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.437890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6cb90-c84c-4245-b6e2-af458f3ab2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.438679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6cb90-c84c-4245-b6e2-af458f3ab2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:47.440422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6cb90-c84c-4245-b6e2-af458f3ab2c2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:47.451244 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1030/2046] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:47 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:09:47.456148 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864090e-314b-4d72-8812-97ce57e226d5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:47.467383 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864090e-314b-4d72-8812-97ce57e226d5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:47.475262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c013a81-661f-4170-b714-fe1609ea8078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:47.475262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c013a81-661f-4170-b714-fe1609ea8078 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.475262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c013a81-661f-4170-b714-fe1609ea8078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.475262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c013a81-661f-4170-b714-fe1609ea8078 admin admin] PATH_INFO: `/v3/projects/00d5159adefa4ab3a4a1dd7e8644e21c/users/2e74b99857c54e77a4cec656ead32ae5/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.493030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c013a81-661f-4170-b714-fe1609ea8078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d5159adefa4ab3a4a1dd7e8644e21c, user_id=2e74b99857c54e77a4cec656ead32ae5, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:47.505171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c013a81-661f-4170-b714-fe1609ea8078 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:47.529366 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1017/2047] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:47 2021] PUT /identity/v3/projects/00d5159adefa4ab3a4a1dd7e8644e21c/users/2e74b99857c54e77a4cec656ead32ae5/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:47.547472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6b6d0-3d66-4fb6-b62b-206dfd69afe4 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.547932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6b6d0-3d66-4fb6-b62b-206dfd69afe4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.548230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6b6d0-3d66-4fb6-b62b-206dfd69afe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.588945 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-83e6b6d0-3d66-4fb6-b62b-206dfd69afe4 None None] MFA Rules not processed for user `2e74b99857c54e77a4cec656ead32ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:47.590005 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-83e6b6d0-3d66-4fb6-b62b-206dfd69afe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:47.675344 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1031/2048] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:47 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:47.679924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c013a81-661f-4170-b714-fe1609ea8078 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:47.750822 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c013a81-661f-4170-b714-fe1609ea8078 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:47.755786 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c7633-0ab8-4e2b-b286-b41d4e666bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:47.756460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c7633-0ab8-4e2b-b286-b41d4e666bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.756749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c7633-0ab8-4e2b-b286-b41d4e666bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.757029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c7633-0ab8-4e2b-b286-b41d4e666bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.757748 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c7633-0ab8-4e2b-b286-b41d4e666bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:47.759773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c7633-0ab8-4e2b-b286-b41d4e666bb8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:47.785084 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1018/2049] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:47 2021] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:47.789353 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6b6d0-3d66-4fb6-b62b-206dfd69afe4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:47.800312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6b6d0-3d66-4fb6-b62b-206dfd69afe4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:47.859691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d35a-3c36-440a-ada2-afaf92e611ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:47.860369 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d35a-3c36-440a-ada2-afaf92e611ed admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.860652 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d35a-3c36-440a-ada2-afaf92e611ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.860928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d35a-3c36-440a-ada2-afaf92e611ed admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.861658 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245d35a-3c36-440a-ada2-afaf92e611ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:47.863630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245d35a-3c36-440a-ada2-afaf92e611ed admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:47.885073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1032/2050] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:47 2021] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:47.888807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c7633-0ab8-4e2b-b286-b41d4e666bb8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:47.901302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c7633-0ab8-4e2b-b286-b41d4e666bb8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:47.906467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f1759-5425-496d-beb1-ce049df4fd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:47.907757 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f1759-5425-496d-beb1-ce049df4fd97 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.908049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f1759-5425-496d-beb1-ce049df4fd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.908337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f1759-5425-496d-beb1-ce049df4fd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.909095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f1759-5425-496d-beb1-ce049df4fd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:47.910751 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f1759-5425-496d-beb1-ce049df4fd97 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:47.924604 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1019/2051] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:47 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:47.928817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d35a-3c36-440a-ada2-afaf92e611ed admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:47.939322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d35a-3c36-440a-ada2-afaf92e611ed admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:47.945474 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e1b9-8a62-4483-a86c-185536ea077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:47.946414 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e1b9-8a62-4483-a86c-185536ea077d admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:47.946703 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e1b9-8a62-4483-a86c-185536ea077d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:47.946983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e1b9-8a62-4483-a86c-185536ea077d admin admin] PATH_INFO: `/v3/projects/89fcc93ba02c4837aed61032f486feb7/users/47a98bd660f3452989fcab211fe7748f/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:47.964176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e1b9-8a62-4483-a86c-185536ea077d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89fcc93ba02c4837aed61032f486feb7, user_id=47a98bd660f3452989fcab211fe7748f, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:47.966975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e1b9-8a62-4483-a86c-185536ea077d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:47.982147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1033/2052] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:47 2021] PUT /identity/v3/projects/89fcc93ba02c4837aed61032f486feb7/users/47a98bd660f3452989fcab211fe7748f/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:47.986224 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f1759-5425-496d-beb1-ce049df4fd97 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:47.996004 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f1759-5425-496d-beb1-ce049df4fd97 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:48.060196 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973b491-5da3-408b-984a-759a11562d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:48.061755 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973b491-5da3-408b-984a-759a11562d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:48.062278 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973b491-5da3-408b-984a-759a11562d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:48.062713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973b491-5da3-408b-984a-759a11562d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:48.063590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973b491-5da3-408b-984a-759a11562d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:48.065616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973b491-5da3-408b-984a-759a11562d7f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:48.080302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1020/2053] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:47 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:48.084247 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e1b9-8a62-4483-a86c-185536ea077d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:48.098292 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e1b9-8a62-4483-a86c-185536ea077d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:48.103953 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25508b-5a49-4b73-9506-f3f9fb60a097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:48.104910 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25508b-5a49-4b73-9506-f3f9fb60a097 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:48.105272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25508b-5a49-4b73-9506-f3f9fb60a097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:48.105612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25508b-5a49-4b73-9506-f3f9fb60a097 admin admin] PATH_INFO: `/v3/projects/89fcc93ba02c4837aed61032f486feb7/users/47a98bd660f3452989fcab211fe7748f/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:48.112026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25508b-5a49-4b73-9506-f3f9fb60a097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89fcc93ba02c4837aed61032f486feb7, user_id=47a98bd660f3452989fcab211fe7748f, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:48.114709 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25508b-5a49-4b73-9506-f3f9fb60a097 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:48.125577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1034/2054] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:48 2021] PUT /identity/v3/projects/89fcc93ba02c4837aed61032f486feb7/users/47a98bd660f3452989fcab211fe7748f/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:48.136173 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2514c7e-b3e7-4559-86f1-69cb34995e7e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:48.136541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2514c7e-b3e7-4559-86f1-69cb34995e7e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:48.136886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2514c7e-b3e7-4559-86f1-69cb34995e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:48.166696 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b2514c7e-b3e7-4559-86f1-69cb34995e7e None None] MFA Rules not processed for user `47a98bd660f3452989fcab211fe7748f`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:48.167910 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b2514c7e-b3e7-4559-86f1-69cb34995e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:48.240000 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1021/2055] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:48 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:48.250359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25508b-5a49-4b73-9506-f3f9fb60a097 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:48.252110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-de25508b-5a49-4b73-9506-f3f9fb60a097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:48.311456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25508b-5a49-4b73-9506-f3f9fb60a097 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:48.315305 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad9530-0414-41b6-b906-c322037e52bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:48.316045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad9530-0414-41b6-b906-c322037e52bf service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:48.316387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad9530-0414-41b6-b906-c322037e52bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:48.316729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad9530-0414-41b6-b906-c322037e52bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:48.326991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad9530-0414-41b6-b906-c322037e52bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:48.328523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad9530-0414-41b6-b906-c322037e52bf service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:48.338752 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1035/2056] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:48 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:48.464844 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2514c7e-b3e7-4559-86f1-69cb34995e7e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:48.532319 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2514c7e-b3e7-4559-86f1-69cb34995e7e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:48.536921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:48.537787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:48.538073 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:48.538348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] PATH_INFO: `/v3/users/2e74b99857c54e77a4cec656ead32ae5` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:48.539580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e74b99857c54e77a4cec656ead32ae5)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:48.541716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:48.588186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e74b99857c54e77a4cec656ead32ae5'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:48.596923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e74b99857c54e77a4cec656ead32ae5'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:48.597661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e74b99857c54e77a4cec656ead32ae5'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:48.598332 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e74b99857c54e77a4cec656ead32ae5'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:48.610613 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e74b99857c54e77a4cec656ead32ae5'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:48.625029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1022/2057] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:48 2021] DELETE /identity/v3/users/2e74b99857c54e77a4cec656ead32ae5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:48.636826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6700c8-3418-41cf-942d-d272204c58cc None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:48.637297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6700c8-3418-41cf-942d-d272204c58cc None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:48.637740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6700c8-3418-41cf-942d-d272204c58cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:48.667980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-0c6700c8-3418-41cf-942d-d272204c58cc None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:48.669412 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0c6700c8-3418-41cf-942d-d272204c58cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:48.739760 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1036/2058] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:48.750183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:48.751621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:48.813973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53daa024-29f0-440e-90ae-c2979c626d45 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:48.817914 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b98daa-9b51-4bb6-8bfe-de39ddb744e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:48.818683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b98daa-9b51-4bb6-8bfe-de39ddb744e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:48.818998 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b98daa-9b51-4bb6-8bfe-de39ddb744e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:48.819254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b98daa-9b51-4bb6-8bfe-de39ddb744e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:48.834211 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b98daa-9b51-4bb6-8bfe-de39ddb744e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:48.835563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b98daa-9b51-4bb6-8bfe-de39ddb744e8 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:48.846295 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1023/2059] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:49.127470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6700c8-3418-41cf-942d-d272204c58cc None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:49.131547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0c6700c8-3418-41cf-942d-d272204c58cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:49.158814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6700c8-3418-41cf-942d-d272204c58cc None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:49.175060 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:49.176201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:49.176485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:49.176779 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] PATH_INFO: `/v3/projects/00d5159adefa4ab3a4a1dd7e8644e21c` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:49.178143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d5159adefa4ab3a4a1dd7e8644e21c)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:49.180315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:49.229442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d5159adefa4ab3a4a1dd7e8644e21c', 'request_id': 'req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.236018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d5159adefa4ab3a4a1dd7e8644e21c', 'request_id': 'req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.243496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d5159adefa4ab3a4a1dd7e8644e21c', 'request_id': 'req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.256822 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] The token cache is being invalidate because project 00d5159adefa4ab3a4a1dd7e8644e21c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:49.257114 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.257978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.259614 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1037/2060] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:49 2021] DELETE /identity/v3/projects/00d5159adefa4ab3a4a1dd7e8644e21c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:49.263896 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b98daa-9b51-4bb6-8bfe-de39ddb744e8 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:49.274629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b98daa-9b51-4bb6-8bfe-de39ddb744e8 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:49.340877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277c5ae-c41a-46f9-a0c4-35b1b171fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:49.342179 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277c5ae-c41a-46f9-a0c4-35b1b171fb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:49.342511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277c5ae-c41a-46f9-a0c4-35b1b171fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:49.342794 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277c5ae-c41a-46f9-a0c4-35b1b171fb5c admin admin] PATH_INFO: `/v3/users/47a98bd660f3452989fcab211fe7748f` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:49.346146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277c5ae-c41a-46f9-a0c4-35b1b171fb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a98bd660f3452989fcab211fe7748f)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:49.346396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277c5ae-c41a-46f9-a0c4-35b1b171fb5c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:49.399805 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d277c5ae-c41a-46f9-a0c4-35b1b171fb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a98bd660f3452989fcab211fe7748f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.407626 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d277c5ae-c41a-46f9-a0c4-35b1b171fb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a98bd660f3452989fcab211fe7748f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.408338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d277c5ae-c41a-46f9-a0c4-35b1b171fb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a98bd660f3452989fcab211fe7748f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.408965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d277c5ae-c41a-46f9-a0c4-35b1b171fb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a98bd660f3452989fcab211fe7748f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.421038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d277c5ae-c41a-46f9-a0c4-35b1b171fb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a98bd660f3452989fcab211fe7748f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.437249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1024/2061] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:49 2021] DELETE /identity/v3/users/47a98bd660f3452989fcab211fe7748f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:49.738968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:49.740738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:49.755155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c66d2-2ccf-4fef-a0c6-8a86f0da7c3f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:49.821184 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525a4dc-9338-4701-81e2-1ed6152bfcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:49.824349 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525a4dc-9338-4701-81e2-1ed6152bfcbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:49.824645 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525a4dc-9338-4701-81e2-1ed6152bfcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:49.824977 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525a4dc-9338-4701-81e2-1ed6152bfcbe admin admin] PATH_INFO: `/v3/projects/89fcc93ba02c4837aed61032f486feb7` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:49.826402 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525a4dc-9338-4701-81e2-1ed6152bfcbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=89fcc93ba02c4837aed61032f486feb7)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:49.828495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525a4dc-9338-4701-81e2-1ed6152bfcbe admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:49.899341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4525a4dc-9338-4701-81e2-1ed6152bfcbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89fcc93ba02c4837aed61032f486feb7', 'request_id': 'req-4525a4dc-9338-4701-81e2-1ed6152bfcbe'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.907017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4525a4dc-9338-4701-81e2-1ed6152bfcbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89fcc93ba02c4837aed61032f486feb7', 'request_id': 'req-4525a4dc-9338-4701-81e2-1ed6152bfcbe'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.916018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4525a4dc-9338-4701-81e2-1ed6152bfcbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89fcc93ba02c4837aed61032f486feb7', 'request_id': 'req-4525a4dc-9338-4701-81e2-1ed6152bfcbe'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.927296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4525a4dc-9338-4701-81e2-1ed6152bfcbe admin admin] The token cache is being invalidate because project 89fcc93ba02c4837aed61032f486feb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:49.927576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4525a4dc-9338-4701-81e2-1ed6152bfcbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.928275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4525a4dc-9338-4701-81e2-1ed6152bfcbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:49.930731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1038/2062] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:49 2021] DELETE /identity/v3/projects/89fcc93ba02c4837aed61032f486feb7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:49.936736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0692b48-6027-41b4-9953-caf3d130dfc6 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:49.937189 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0692b48-6027-41b4-9953-caf3d130dfc6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:49.937377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0692b48-6027-41b4-9953-caf3d130dfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:49.957103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d0692b48-6027-41b4-9953-caf3d130dfc6 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:49.958383 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d0692b48-6027-41b4-9953-caf3d130dfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:50.039673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1025/2063] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:50.052332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e7356-b6fc-43b6-a075-a4973014022b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:50.052619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e7356-b6fc-43b6-a075-a4973014022b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:50.052920 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e7356-b6fc-43b6-a075-a4973014022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:50.074965 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d09e7356-b6fc-43b6-a075-a4973014022b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:50.076260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d09e7356-b6fc-43b6-a075-a4973014022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:50.087165 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1039/2064] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:50.091990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0692b48-6027-41b4-9953-caf3d130dfc6 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:50.104552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0692b48-6027-41b4-9953-caf3d130dfc6 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:50.110883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a93a99-7215-4461-9793-ca3adacc4f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:50.111570 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a93a99-7215-4461-9793-ca3adacc4f3a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:50.111856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a93a99-7215-4461-9793-ca3adacc4f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:50.112129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a93a99-7215-4461-9793-ca3adacc4f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:50.112871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a93a99-7215-4461-9793-ca3adacc4f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:50.113465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a93a99-7215-4461-9793-ca3adacc4f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:50.115557 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a93a99-7215-4461-9793-ca3adacc4f3a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:50.131091 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1026/2065] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:09:50.136559 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e7356-b6fc-43b6-a075-a4973014022b None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:50.147548 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e7356-b6fc-43b6-a075-a4973014022b None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:50.169025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0f6b0-3fdd-480a-88db-b5e587fb5eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:50.169988 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0f6b0-3fdd-480a-88db-b5e587fb5eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:50.170419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0f6b0-3fdd-480a-88db-b5e587fb5eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:50.170697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0f6b0-3fdd-480a-88db-b5e587fb5eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:50.171894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0f6b0-3fdd-480a-88db-b5e587fb5eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:50.174935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0f6b0-3fdd-480a-88db-b5e587fb5eb7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:50.210122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1040/2066] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:50 2021] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:50.210736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a93a99-7215-4461-9793-ca3adacc4f3a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:50.221912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a93a99-7215-4461-9793-ca3adacc4f3a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:50.280447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0f6b0-3fdd-480a-88db-b5e587fb5eb7 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:50.282119 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-68c0f6b0-3fdd-480a-88db-b5e587fb5eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:50.283909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ade03-de59-4ce1-80c5-91c997253038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:50.284742 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ade03-de59-4ce1-80c5-91c997253038 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:50.285033 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ade03-de59-4ce1-80c5-91c997253038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:50.285310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ade03-de59-4ce1-80c5-91c997253038 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:50.286071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ade03-de59-4ce1-80c5-91c997253038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:50.288030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ade03-de59-4ce1-80c5-91c997253038 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:50.296543 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0f6b0-3fdd-480a-88db-b5e587fb5eb7 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:50.301904 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177a97-8322-4d9d-9b4d-eb7422b5d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:50.302821 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177a97-8322-4d9d-9b4d-eb7422b5d923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:50.303094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177a97-8322-4d9d-9b4d-eb7422b5d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:50.303605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177a97-8322-4d9d-9b4d-eb7422b5d923 admin admin] PATH_INFO: `/v3/users/7066c62f8c784f1eadcdeb530ead6a4f` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:50.305108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20177a97-8322-4d9d-9b4d-eb7422b5d923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7066c62f8c784f1eadcdeb530ead6a4f)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:50.307639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20177a97-8322-4d9d-9b4d-eb7422b5d923 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:50.311899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1027/2067] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:50 2021] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:50.316446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ade03-de59-4ce1-80c5-91c997253038 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:50.326141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ade03-de59-4ce1-80c5-91c997253038 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:50.331330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916cded-2af1-420e-8fac-94bf73429ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:50.332081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916cded-2af1-420e-8fac-94bf73429ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:50.332344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916cded-2af1-420e-8fac-94bf73429ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:50.332695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916cded-2af1-420e-8fac-94bf73429ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:50.333522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916cded-2af1-420e-8fac-94bf73429ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:50.336750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916cded-2af1-420e-8fac-94bf73429ad9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:50.346338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1028/2068] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:09:50.350407 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916cded-2af1-420e-8fac-94bf73429ad9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:50.357715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-20177a97-8322-4d9d-9b4d-eb7422b5d923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7066c62f8c784f1eadcdeb530ead6a4f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:50.359317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-20177a97-8322-4d9d-9b4d-eb7422b5d923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7066c62f8c784f1eadcdeb530ead6a4f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:50.366401 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916cded-2af1-420e-8fac-94bf73429ad9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:50.371254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-20177a97-8322-4d9d-9b4d-eb7422b5d923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7066c62f8c784f1eadcdeb530ead6a4f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:50.372095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcf5e0-b7fd-4de2-b654-78c912cb47d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:50.372235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-20177a97-8322-4d9d-9b4d-eb7422b5d923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7066c62f8c784f1eadcdeb530ead6a4f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:50.372907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcf5e0-b7fd-4de2-b654-78c912cb47d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:50.373198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcf5e0-b7fd-4de2-b654-78c912cb47d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:50.373467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcf5e0-b7fd-4de2-b654-78c912cb47d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:50.374385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcf5e0-b7fd-4de2-b654-78c912cb47d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:50.376186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcf5e0-b7fd-4de2-b654-78c912cb47d9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:50.385442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-20177a97-8322-4d9d-9b4d-eb7422b5d923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7066c62f8c784f1eadcdeb530ead6a4f'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:50.388098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1029/2069] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:50 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:09:50.392244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcf5e0-b7fd-4de2-b654-78c912cb47d9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:50.394402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d4bcf5e0-b7fd-4de2-b654-78c912cb47d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:50.406271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1041/2070] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:50 2021] DELETE /identity/v3/users/7066c62f8c784f1eadcdeb530ead6a4f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:50.407747 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcf5e0-b7fd-4de2-b654-78c912cb47d9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:50.411418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35319e8e-a9ad-4ebc-848e-cd9857fc8496 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:50.411637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35319e8e-a9ad-4ebc-848e-cd9857fc8496 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:50.411915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35319e8e-a9ad-4ebc-848e-cd9857fc8496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:50.432298 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-35319e8e-a9ad-4ebc-848e-cd9857fc8496 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:50.433532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-35319e8e-a9ad-4ebc-848e-cd9857fc8496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:50.464272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3708c0-b6dc-491a-a2d0-b61ef90132ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:50.465334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3708c0-b6dc-491a-a2d0-b61ef90132ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:50.465619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3708c0-b6dc-491a-a2d0-b61ef90132ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:50.465899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3708c0-b6dc-491a-a2d0-b61ef90132ef admin admin] PATH_INFO: `/v3/projects/dd1f22094bc94a269f27968fba9adcd4/users/752b7eb5866748c4b94210fcd9b3a904/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:50.480916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3708c0-b6dc-491a-a2d0-b61ef90132ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1f22094bc94a269f27968fba9adcd4, user_id=752b7eb5866748c4b94210fcd9b3a904, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:50.483673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3708c0-b6dc-491a-a2d0-b61ef90132ef admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:50.492681 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1042/2071] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:50.498782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1030/2072] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:50 2021] PUT /identity/v3/projects/dd1f22094bc94a269f27968fba9adcd4/users/752b7eb5866748c4b94210fcd9b3a904/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:50.509270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811d60a-58dd-4f6e-8feb-e0013ed6e878 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:50.509581 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811d60a-58dd-4f6e-8feb-e0013ed6e878 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:50.509863 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811d60a-58dd-4f6e-8feb-e0013ed6e878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:50.511482 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3708c0-b6dc-491a-a2d0-b61ef90132ef admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:50.513299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5b3708c0-b6dc-491a-a2d0-b61ef90132ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:50.535670 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2811d60a-58dd-4f6e-8feb-e0013ed6e878 None None] MFA Rules not processed for user `752b7eb5866748c4b94210fcd9b3a904`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:50.536887 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2811d60a-58dd-4f6e-8feb-e0013ed6e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:50.569100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3708c0-b6dc-491a-a2d0-b61ef90132ef admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:50.574453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a13a86-1934-48a0-a314-551a2e90f907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:50.575096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a13a86-1934-48a0-a314-551a2e90f907 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:50.575377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a13a86-1934-48a0-a314-551a2e90f907 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:50.575651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a13a86-1934-48a0-a314-551a2e90f907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:50.610938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1043/2073] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:50 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:50.620195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811d60a-58dd-4f6e-8feb-e0013ed6e878 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:50.622397 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2811d60a-58dd-4f6e-8feb-e0013ed6e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:50.641906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a13a86-1934-48a0-a314-551a2e90f907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:50.647050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a13a86-1934-48a0-a314-551a2e90f907 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:50.657518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1031/2074] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:50.682306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811d60a-58dd-4f6e-8feb-e0013ed6e878 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:50.686845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8b181-f47d-4840-b04e-6590c98daf33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d001733477f499e937ba90e7e50ba33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:50.687513 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8b181-f47d-4840-b04e-6590c98daf33 service glance] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:50.687791 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8b181-f47d-4840-b04e-6590c98daf33 service glance] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:50.688065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8b181-f47d-4840-b04e-6590c98daf33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:50.698486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8b181-f47d-4840-b04e-6590c98daf33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:50.700343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8b181-f47d-4840-b04e-6590c98daf33 service glance] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:50.710150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1044/2075] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:50 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:09:51.093430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a13a86-1934-48a0-a314-551a2e90f907 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:51.095113 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b9a13a86-1934-48a0-a314-551a2e90f907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:51.118546 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a13a86-1934-48a0-a314-551a2e90f907 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:51.124325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ddcb2-14fc-49ed-a15d-5714f821a7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:51.126117 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ddcb2-14fc-49ed-a15d-5714f821a7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:51.126453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ddcb2-14fc-49ed-a15d-5714f821a7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:51.126746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ddcb2-14fc-49ed-a15d-5714f821a7c9 admin admin] PATH_INFO: `/v3/projects/407c5c21060f4886958c48cbe475da5f` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:51.128015 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ddcb2-14fc-49ed-a15d-5714f821a7c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=407c5c21060f4886958c48cbe475da5f)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:51.130001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ddcb2-14fc-49ed-a15d-5714f821a7c9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:51.184956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-329ddcb2-14fc-49ed-a15d-5714f821a7c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407c5c21060f4886958c48cbe475da5f', 'request_id': 'req-329ddcb2-14fc-49ed-a15d-5714f821a7c9'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:51.190989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-329ddcb2-14fc-49ed-a15d-5714f821a7c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407c5c21060f4886958c48cbe475da5f', 'request_id': 'req-329ddcb2-14fc-49ed-a15d-5714f821a7c9'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:51.198615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-329ddcb2-14fc-49ed-a15d-5714f821a7c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407c5c21060f4886958c48cbe475da5f', 'request_id': 'req-329ddcb2-14fc-49ed-a15d-5714f821a7c9'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:51.213867 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-329ddcb2-14fc-49ed-a15d-5714f821a7c9 admin admin] The token cache is being invalidate because project 407c5c21060f4886958c48cbe475da5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:51.214404 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-329ddcb2-14fc-49ed-a15d-5714f821a7c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:51.215225 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-329ddcb2-14fc-49ed-a15d-5714f821a7c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:51.217413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1032/2076] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:51 2021] DELETE /identity/v3/projects/407c5c21060f4886958c48cbe475da5f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:51.224106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26102613-df44-4bd1-9f44-a42b0283f3c7 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:51.225868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26102613-df44-4bd1-9f44-a42b0283f3c7 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:51.226356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26102613-df44-4bd1-9f44-a42b0283f3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:51.251087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-26102613-df44-4bd1-9f44-a42b0283f3c7 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:51.252516 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-26102613-df44-4bd1-9f44-a42b0283f3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:51.333322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1045/2077] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:51.342358 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5b574-e561-428d-86a0-e430399187f7 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:51.342604 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5b574-e561-428d-86a0-e430399187f7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:51.342861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5b574-e561-428d-86a0-e430399187f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:51.364161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b7e5b574-e561-428d-86a0-e430399187f7 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:51.366072 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b7e5b574-e561-428d-86a0-e430399187f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:51.377415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1033/2078] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:51.381589 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26102613-df44-4bd1-9f44-a42b0283f3c7 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:51.393663 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26102613-df44-4bd1-9f44-a42b0283f3c7 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:51.401153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f8cd5-5108-4b6e-8720-0c592e8ca118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:51.401826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f8cd5-5108-4b6e-8720-0c592e8ca118 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:51.402108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f8cd5-5108-4b6e-8720-0c592e8ca118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:51.402407 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f8cd5-5108-4b6e-8720-0c592e8ca118 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:51.403184 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f8cd5-5108-4b6e-8720-0c592e8ca118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:51.403515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f8cd5-5108-4b6e-8720-0c592e8ca118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:51.405155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f8cd5-5108-4b6e-8720-0c592e8ca118 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:51.418414 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1046/2079] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:09:51.422820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5b574-e561-428d-86a0-e430399187f7 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:51.433016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5b574-e561-428d-86a0-e430399187f7 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:51.438164 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f1a3a-b378-4bc3-81ad-9ff15716cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:51.439035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f1a3a-b378-4bc3-81ad-9ff15716cb88 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:51.439417 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f1a3a-b378-4bc3-81ad-9ff15716cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:51.439784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f1a3a-b378-4bc3-81ad-9ff15716cb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:51.440595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f1a3a-b378-4bc3-81ad-9ff15716cb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:51.442778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f1a3a-b378-4bc3-81ad-9ff15716cb88 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:51.477906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1034/2080] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:51 2021] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:51.483016 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f8cd5-5108-4b6e-8720-0c592e8ca118 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:51.493572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f8cd5-5108-4b6e-8720-0c592e8ca118 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:51.563336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7580214-f144-4bfe-ae65-2b36f32f3acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:51.565193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7580214-f144-4bfe-ae65-2b36f32f3acb admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:51.565193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7580214-f144-4bfe-ae65-2b36f32f3acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:51.565193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7580214-f144-4bfe-ae65-2b36f32f3acb admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:51.565477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7580214-f144-4bfe-ae65-2b36f32f3acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:51.567329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7580214-f144-4bfe-ae65-2b36f32f3acb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:51.594291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1047/2081] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:51 2021] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:51.595994 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f1a3a-b378-4bc3-81ad-9ff15716cb88 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:51.607303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f1a3a-b378-4bc3-81ad-9ff15716cb88 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:51.612654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ad15d-1df7-477a-b008-e2d05b7833e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:51.613309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ad15d-1df7-477a-b008-e2d05b7833e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:51.613588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ad15d-1df7-477a-b008-e2d05b7833e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:51.613860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ad15d-1df7-477a-b008-e2d05b7833e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:51.614624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ad15d-1df7-477a-b008-e2d05b7833e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:51.616212 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ad15d-1df7-477a-b008-e2d05b7833e3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:51.628377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1035/2082] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:51 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:51.632468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7580214-f144-4bfe-ae65-2b36f32f3acb admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:51.643597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7580214-f144-4bfe-ae65-2b36f32f3acb admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:51.655937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef059f-be0d-45c7-9cca-ea55d9104b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:51.656676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef059f-be0d-45c7-9cca-ea55d9104b27 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:51.657003 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef059f-be0d-45c7-9cca-ea55d9104b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:51.657327 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef059f-be0d-45c7-9cca-ea55d9104b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:51.658122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef059f-be0d-45c7-9cca-ea55d9104b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:51.659859 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef059f-be0d-45c7-9cca-ea55d9104b27 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:51.672781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1048/2083] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:51 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:51.677155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ad15d-1df7-477a-b008-e2d05b7833e3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:51.689276 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ad15d-1df7-477a-b008-e2d05b7833e3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:51.694102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c823b30-211d-4b0d-b43b-06e33a34912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:51.695013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c823b30-211d-4b0d-b43b-06e33a34912e admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:51.695468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c823b30-211d-4b0d-b43b-06e33a34912e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:51.695739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c823b30-211d-4b0d-b43b-06e33a34912e admin admin] PATH_INFO: `/v3/projects/d6d5beaac0f5499ebdb7f15879cf5c9b/users/fc6ef8627a3a40638168ed0d45c19d95/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:51.713895 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c823b30-211d-4b0d-b43b-06e33a34912e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d5beaac0f5499ebdb7f15879cf5c9b, user_id=fc6ef8627a3a40638168ed0d45c19d95, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:51.716604 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c823b30-211d-4b0d-b43b-06e33a34912e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:51.732041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1036/2084] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:51 2021] PUT /identity/v3/projects/d6d5beaac0f5499ebdb7f15879cf5c9b/users/fc6ef8627a3a40638168ed0d45c19d95/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:51.737151 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e438e-dbf8-473d-9dee-55225ad16df5 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:51.737452 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e438e-dbf8-473d-9dee-55225ad16df5 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:51.737783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e438e-dbf8-473d-9dee-55225ad16df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:51.757307 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2f9e438e-dbf8-473d-9dee-55225ad16df5 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:51.758644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2f9e438e-dbf8-473d-9dee-55225ad16df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:51.840426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1049/2085] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:51.859670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c823b30-211d-4b0d-b43b-06e33a34912e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:51.861773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5c823b30-211d-4b0d-b43b-06e33a34912e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:51.958681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c823b30-211d-4b0d-b43b-06e33a34912e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:51.958681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec21d7f-3b09-401b-b00b-6b60c1f6adf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:51.958681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec21d7f-3b09-401b-b00b-6b60c1f6adf4 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:51.958681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec21d7f-3b09-401b-b00b-6b60c1f6adf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:51.959025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec21d7f-3b09-401b-b00b-6b60c1f6adf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:51.969733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec21d7f-3b09-401b-b00b-6b60c1f6adf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:51.971602 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec21d7f-3b09-401b-b00b-6b60c1f6adf4 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:51.982813 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1037/2086] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:53.167856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ab2d2-ffc9-4d61-9f95-be7f8111741e None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:53.169413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ab2d2-ffc9-4d61-9f95-be7f8111741e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:53.169748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ab2d2-ffc9-4d61-9f95-be7f8111741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:53.190287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ce3ab2d2-ffc9-4d61-9f95-be7f8111741e None None] MFA Rules not processed for user `59d2b98f1809405ab307a035062400c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:53.192022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ce3ab2d2-ffc9-4d61-9f95-be7f8111741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:53.288008 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1050/2087] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:53 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:54.560973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec21d7f-3b09-401b-b00b-6b60c1f6adf4 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:54.567042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-dec21d7f-3b09-401b-b00b-6b60c1f6adf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:54.592221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec21d7f-3b09-401b-b00b-6b60c1f6adf4 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:54.598656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af93d4-4cf0-449d-9674-ef2ca86d477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:54.599536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af93d4-4cf0-449d-9674-ef2ca86d477e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:54.601599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af93d4-4cf0-449d-9674-ef2ca86d477e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:54.601814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af93d4-4cf0-449d-9674-ef2ca86d477e admin admin] PATH_INFO: `/v3/users/98b74ad2c40f4a7caf926c7954046137` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:54.605654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af93d4-4cf0-449d-9674-ef2ca86d477e admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b74ad2c40f4a7caf926c7954046137)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:54.607673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af93d4-4cf0-449d-9674-ef2ca86d477e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:54.683224 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a2af93d4-4cf0-449d-9674-ef2ca86d477e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b74ad2c40f4a7caf926c7954046137'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:54.691172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a2af93d4-4cf0-449d-9674-ef2ca86d477e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b74ad2c40f4a7caf926c7954046137'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:54.691899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a2af93d4-4cf0-449d-9674-ef2ca86d477e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b74ad2c40f4a7caf926c7954046137'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:54.692639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a2af93d4-4cf0-449d-9674-ef2ca86d477e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b74ad2c40f4a7caf926c7954046137'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:54.712704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a2af93d4-4cf0-449d-9674-ef2ca86d477e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b74ad2c40f4a7caf926c7954046137'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:54.730151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1038/2088] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:54 2021] DELETE /identity/v3/users/98b74ad2c40f4a7caf926c7954046137 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:55.024217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ab2d2-ffc9-4d61-9f95-be7f8111741e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:55.051697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ab2d2-ffc9-4d61-9f95-be7f8111741e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:55.187457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f1abd-37ac-44b5-bb01-809506325d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:55.189580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f1abd-37ac-44b5-bb01-809506325d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:55.190303 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f1abd-37ac-44b5-bb01-809506325d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:55.190816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f1abd-37ac-44b5-bb01-809506325d62 admin admin] PATH_INFO: `/v3/projects/f744683c3f364dda933c885766c8dfec` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:55.194759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f1abd-37ac-44b5-bb01-809506325d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f744683c3f364dda933c885766c8dfec)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:55.200405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f1abd-37ac-44b5-bb01-809506325d62 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:55.275545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4d0f1abd-37ac-44b5-bb01-809506325d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f744683c3f364dda933c885766c8dfec', 'request_id': 'req-4d0f1abd-37ac-44b5-bb01-809506325d62'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:55.284137 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4d0f1abd-37ac-44b5-bb01-809506325d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f744683c3f364dda933c885766c8dfec', 'request_id': 'req-4d0f1abd-37ac-44b5-bb01-809506325d62'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:55.293678 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4d0f1abd-37ac-44b5-bb01-809506325d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f744683c3f364dda933c885766c8dfec', 'request_id': 'req-4d0f1abd-37ac-44b5-bb01-809506325d62'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:55.310110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4d0f1abd-37ac-44b5-bb01-809506325d62 admin admin] The token cache is being invalidate because project f744683c3f364dda933c885766c8dfec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:55.311610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4d0f1abd-37ac-44b5-bb01-809506325d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:55.313143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4d0f1abd-37ac-44b5-bb01-809506325d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:55.315298 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1051/2089] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:55 2021] DELETE /identity/v3/projects/f744683c3f364dda933c885766c8dfec => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:55.321120 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cc853-1eb5-4233-860e-bb26d0b4b0c9 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:55.321501 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cc853-1eb5-4233-860e-bb26d0b4b0c9 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:55.323727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cc853-1eb5-4233-860e-bb26d0b4b0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:55.356261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-545cc853-1eb5-4233-860e-bb26d0b4b0c9 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:55.357904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-545cc853-1eb5-4233-860e-bb26d0b4b0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:55.436193 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1039/2090] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:55.444825 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5f0f-1a23-4fc4-8228-e498e7b633c9 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:55.445145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5f0f-1a23-4fc4-8228-e498e7b633c9 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:55.445428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5f0f-1a23-4fc4-8228-e498e7b633c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:55.487424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-f41b5f0f-1a23-4fc4-8228-e498e7b633c9 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:55.488912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f41b5f0f-1a23-4fc4-8228-e498e7b633c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:55.512635 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1052/2091] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:55.524705 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cc853-1eb5-4233-860e-bb26d0b4b0c9 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:55.535001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cc853-1eb5-4233-860e-bb26d0b4b0c9 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:55.539895 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8270b2-918f-4548-8098-81a33e4d4253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:55.540556 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8270b2-918f-4548-8098-81a33e4d4253 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:55.540921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8270b2-918f-4548-8098-81a33e4d4253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:55.541197 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8270b2-918f-4548-8098-81a33e4d4253 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:55.541937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8270b2-918f-4548-8098-81a33e4d4253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:09:55.542702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8270b2-918f-4548-8098-81a33e4d4253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:55.544248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8270b2-918f-4548-8098-81a33e4d4253 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:55.559394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1040/2092] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:09:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:09:55.564762 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5f0f-1a23-4fc4-8228-e498e7b633c9 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:55.574853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5f0f-1a23-4fc4-8228-e498e7b633c9 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:55.580351 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febe969-ddb1-424a-8d2e-c2d6c428c180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:55.581024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febe969-ddb1-424a-8d2e-c2d6c428c180 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:55.581458 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febe969-ddb1-424a-8d2e-c2d6c428c180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:55.582269 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febe969-ddb1-424a-8d2e-c2d6c428c180 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:55.582605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febe969-ddb1-424a-8d2e-c2d6c428c180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:55.584556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febe969-ddb1-424a-8d2e-c2d6c428c180 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:55.615347 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1053/2093] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:55 2021] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:55.620016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8270b2-918f-4548-8098-81a33e4d4253 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:55.630561 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8270b2-918f-4548-8098-81a33e4d4253 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:55.731994 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab8978-f7c5-47e2-a1f8-635e3c3327eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:55.733033 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab8978-f7c5-47e2-a1f8-635e3c3327eb admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:55.733380 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab8978-f7c5-47e2-a1f8-635e3c3327eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:55.733884 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab8978-f7c5-47e2-a1f8-635e3c3327eb admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:55.734391 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab8978-f7c5-47e2-a1f8-635e3c3327eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:55.737335 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab8978-f7c5-47e2-a1f8-635e3c3327eb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:55.766330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1041/2094] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:55 2021] POST /identity/v3/users => generated 303 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:55.771591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febe969-ddb1-424a-8d2e-c2d6c428c180 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:55.789590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febe969-ddb1-424a-8d2e-c2d6c428c180 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:55.795725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc9709-38ec-434b-9ebc-0cfd07f68a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:55.796975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc9709-38ec-434b-9ebc-0cfd07f68a99 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:55.797501 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc9709-38ec-434b-9ebc-0cfd07f68a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:55.797997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc9709-38ec-434b-9ebc-0cfd07f68a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:55.799013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc9709-38ec-434b-9ebc-0cfd07f68a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:55.800775 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc9709-38ec-434b-9ebc-0cfd07f68a99 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:55.812464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1054/2095] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:55 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:55.816291 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab8978-f7c5-47e2-a1f8-635e3c3327eb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:55.834763 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab8978-f7c5-47e2-a1f8-635e3c3327eb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:55.844368 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50892420-674a-4def-9519-13051b945f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:55.844654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50892420-674a-4def-9519-13051b945f06 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:55.844945 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50892420-674a-4def-9519-13051b945f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:55.845482 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50892420-674a-4def-9519-13051b945f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:55.846247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50892420-674a-4def-9519-13051b945f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:55.848883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50892420-674a-4def-9519-13051b945f06 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:55.868235 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1042/2096] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:55 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:55.870865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc9709-38ec-434b-9ebc-0cfd07f68a99 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:55.886078 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc9709-38ec-434b-9ebc-0cfd07f68a99 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:55.891238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7ab25-d3a9-4221-968c-c78df46c4e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:55.892142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7ab25-d3a9-4221-968c-c78df46c4e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:55.892420 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7ab25-d3a9-4221-968c-c78df46c4e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:55.892693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7ab25-d3a9-4221-968c-c78df46c4e14 admin admin] PATH_INFO: `/v3/projects/c58cceea327941d4ac25160a3941afb4/users/953c149d0a7e49099635a7217b1e1355/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:55.915421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7ab25-d3a9-4221-968c-c78df46c4e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58cceea327941d4ac25160a3941afb4, user_id=953c149d0a7e49099635a7217b1e1355, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:55.919689 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7ab25-d3a9-4221-968c-c78df46c4e14 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:55.938066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1055/2097] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:55 2021] PUT /identity/v3/projects/c58cceea327941d4ac25160a3941afb4/users/953c149d0a7e49099635a7217b1e1355/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:55.948683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd14623-366a-4532-9703-d011f52e6a80 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:55.949062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd14623-366a-4532-9703-d011f52e6a80 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:55.949238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd14623-366a-4532-9703-d011f52e6a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:55.988618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-afd14623-366a-4532-9703-d011f52e6a80 None None] MFA Rules not processed for user `953c149d0a7e49099635a7217b1e1355`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:55.990659 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-afd14623-366a-4532-9703-d011f52e6a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:56.092400 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1043/2098] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:55 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:56.098401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7ab25-d3a9-4221-968c-c78df46c4e14 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:56.221160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7ab25-d3a9-4221-968c-c78df46c4e14 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:56.226246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec6b26-08eb-4fcf-a8dd-a0170bf682bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:56.227502 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec6b26-08eb-4fcf-a8dd-a0170bf682bd admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:56.227940 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec6b26-08eb-4fcf-a8dd-a0170bf682bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:56.228615 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec6b26-08eb-4fcf-a8dd-a0170bf682bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:56.230495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec6b26-08eb-4fcf-a8dd-a0170bf682bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:56.232662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec6b26-08eb-4fcf-a8dd-a0170bf682bd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:56.269387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1056/2099] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:56 2021] POST /identity/v3/projects => generated 403 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:09:56.274129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd14623-366a-4532-9703-d011f52e6a80 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:56.299798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd14623-366a-4532-9703-d011f52e6a80 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:56.389615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80bf32-94d8-44fd-8373-1e5de740ffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:56.390916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80bf32-94d8-44fd-8373-1e5de740ffab admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:56.391477 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80bf32-94d8-44fd-8373-1e5de740ffab admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:56.391810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80bf32-94d8-44fd-8373-1e5de740ffab admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:56.393170 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80bf32-94d8-44fd-8373-1e5de740ffab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:56.394934 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80bf32-94d8-44fd-8373-1e5de740ffab admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:56.426275 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1044/2100] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:56 2021] POST /identity/v3/users => generated 308 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:56.430010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec6b26-08eb-4fcf-a8dd-a0170bf682bd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:56.443334 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec6b26-08eb-4fcf-a8dd-a0170bf682bd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:56.452408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dd928-a742-4d75-8fc2-79ae870c0c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:56.453418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dd928-a742-4d75-8fc2-79ae870c0c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:56.454513 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dd928-a742-4d75-8fc2-79ae870c0c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:56.455228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dd928-a742-4d75-8fc2-79ae870c0c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:56.456496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dd928-a742-4d75-8fc2-79ae870c0c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:56.459402 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dd928-a742-4d75-8fc2-79ae870c0c4a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:56.482948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1057/2101] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:56 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:56.487094 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80bf32-94d8-44fd-8373-1e5de740ffab admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:56.504852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80bf32-94d8-44fd-8373-1e5de740ffab admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:56.510964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb579e71-e06d-42cf-b27e-0bc336ccbd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:56.511929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb579e71-e06d-42cf-b27e-0bc336ccbd22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:56.512289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb579e71-e06d-42cf-b27e-0bc336ccbd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:56.512639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb579e71-e06d-42cf-b27e-0bc336ccbd22 admin admin] PATH_INFO: `/v3/projects/cc58edda2f7445648d838e32912b6247/users/f40234984d6643b2a025b5cd10ea00aa/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:56.543308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb579e71-e06d-42cf-b27e-0bc336ccbd22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc58edda2f7445648d838e32912b6247, user_id=f40234984d6643b2a025b5cd10ea00aa, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:56.546150 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb579e71-e06d-42cf-b27e-0bc336ccbd22 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:56.570399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1045/2102] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:56 2021] PUT /identity/v3/projects/cc58edda2f7445648d838e32912b6247/users/f40234984d6643b2a025b5cd10ea00aa/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:56.575208 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dd928-a742-4d75-8fc2-79ae870c0c4a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:56.592301 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dd928-a742-4d75-8fc2-79ae870c0c4a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:56.684085 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6fc0-02f9-464c-a32e-846d1bed8422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:56.684899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6fc0-02f9-464c-a32e-846d1bed8422 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:56.685353 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6fc0-02f9-464c-a32e-846d1bed8422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:56.685649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6fc0-02f9-464c-a32e-846d1bed8422 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:56.686675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c6fc0-02f9-464c-a32e-846d1bed8422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:56.688602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c6fc0-02f9-464c-a32e-846d1bed8422 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:56.706784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb579e71-e06d-42cf-b27e-0bc336ccbd22 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:56.707324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1058/2103] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:56 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:56.721864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb579e71-e06d-42cf-b27e-0bc336ccbd22 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:56.726681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c2bb5-1a0f-491a-9b18-e958ff794e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:56.727664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c2bb5-1a0f-491a-9b18-e958ff794e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:56.736425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c2bb5-1a0f-491a-9b18-e958ff794e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:56.736783 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c2bb5-1a0f-491a-9b18-e958ff794e44 admin admin] PATH_INFO: `/v3/projects/cc58edda2f7445648d838e32912b6247/users/f40234984d6643b2a025b5cd10ea00aa/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:56.739299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c2bb5-1a0f-491a-9b18-e958ff794e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc58edda2f7445648d838e32912b6247, user_id=f40234984d6643b2a025b5cd10ea00aa, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:56.742752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c2bb5-1a0f-491a-9b18-e958ff794e44 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:56.757127 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1046/2104] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:56 2021] PUT /identity/v3/projects/cc58edda2f7445648d838e32912b6247/users/f40234984d6643b2a025b5cd10ea00aa/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:56.768883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32243d2-d2b2-46ff-99f0-e915e0696918 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:56.769315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32243d2-d2b2-46ff-99f0-e915e0696918 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:56.769706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32243d2-d2b2-46ff-99f0-e915e0696918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:56.815660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-c32243d2-d2b2-46ff-99f0-e915e0696918 None None] MFA Rules not processed for user `f40234984d6643b2a025b5cd10ea00aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:56.817003 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c32243d2-d2b2-46ff-99f0-e915e0696918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:56.922819 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1059/2105] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:56 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:09:56.936569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c2bb5-1a0f-491a-9b18-e958ff794e44 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:56.939109 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-980c2bb5-1a0f-491a-9b18-e958ff794e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:57.090647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c2bb5-1a0f-491a-9b18-e958ff794e44 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:57.095870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0998a-e370-4598-bae8-90461cdc4dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:57.098009 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0998a-e370-4598-bae8-90461cdc4dfb service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:57.098443 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0998a-e370-4598-bae8-90461cdc4dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:57.098721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0998a-e370-4598-bae8-90461cdc4dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:57.113540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0998a-e370-4598-bae8-90461cdc4dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:57.115044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0998a-e370-4598-bae8-90461cdc4dfb service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:57.144375 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1047/2106] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:56 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:57.329274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32243d2-d2b2-46ff-99f0-e915e0696918 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:57.418888 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32243d2-d2b2-46ff-99f0-e915e0696918 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:57.427867 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:57.429064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:57.429691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:57.430292 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] PATH_INFO: `/v3/users/953c149d0a7e49099635a7217b1e1355` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:57.433942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=953c149d0a7e49099635a7217b1e1355)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:57.438022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:57.520174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953c149d0a7e49099635a7217b1e1355'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:57.521018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953c149d0a7e49099635a7217b1e1355'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:57.547297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953c149d0a7e49099635a7217b1e1355'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:57.549829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953c149d0a7e49099635a7217b1e1355'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:57.570610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953c149d0a7e49099635a7217b1e1355'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:57.615330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1060/2107] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:57 2021] DELETE /identity/v3/users/953c149d0a7e49099635a7217b1e1355 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:57.617358 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8110dd-e332-448a-ab62-e222c56b668b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:57.617870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8110dd-e332-448a-ab62-e222c56b668b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:57.618354 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8110dd-e332-448a-ab62-e222c56b668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:57.659014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-cc8110dd-e332-448a-ab62-e222c56b668b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:57.661410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-cc8110dd-e332-448a-ab62-e222c56b668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:57.787601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1048/2108] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:57.808946 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:57.815148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:57.911081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36a840-c4ae-4929-9d4e-5b59f805e7d2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:57.918460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f5e13-b9cb-400c-93f8-dbd69ac544df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:57.919138 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f5e13-b9cb-400c-93f8-dbd69ac544df service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:57.919423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f5e13-b9cb-400c-93f8-dbd69ac544df service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:57.919841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f5e13-b9cb-400c-93f8-dbd69ac544df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:57.936048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f5e13-b9cb-400c-93f8-dbd69ac544df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:57.937834 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f5e13-b9cb-400c-93f8-dbd69ac544df service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:57.941704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd3945-7243-45ad-b17a-8d4e238948be None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:57.941995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd3945-7243-45ad-b17a-8d4e238948be None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:57.942281 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd3945-7243-45ad-b17a-8d4e238948be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:57.950543 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1061/2109] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:09:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:09:57.977323 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e5cd3945-7243-45ad-b17a-8d4e238948be None None] MFA Rules not processed for user `fc6ef8627a3a40638168ed0d45c19d95`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:57.980087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e5cd3945-7243-45ad-b17a-8d4e238948be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:58.047731 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1049/2110] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:57 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:09:58.052630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f5e13-b9cb-400c-93f8-dbd69ac544df service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:58.054100 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-8b6f5e13-b9cb-400c-93f8-dbd69ac544df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:58.069382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f5e13-b9cb-400c-93f8-dbd69ac544df service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:58.075437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7580e-d1b2-4850-8554-22ba0ce351e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:58.076193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7580e-d1b2-4850-8554-22ba0ce351e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:58.076548 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7580e-d1b2-4850-8554-22ba0ce351e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:58.076889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7580e-d1b2-4850-8554-22ba0ce351e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:58.077676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7580e-d1b2-4850-8554-22ba0ce351e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:58.079696 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7580e-d1b2-4850-8554-22ba0ce351e2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:58.120839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1062/2111] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:09:58 2021] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:58.125058 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd3945-7243-45ad-b17a-8d4e238948be None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:58.146664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd3945-7243-45ad-b17a-8d4e238948be None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:58.213036 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f3ba0-065c-4be5-994c-fc907eda73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:58.213979 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3ba0-065c-4be5-994c-fc907eda73da admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:58.214298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3ba0-065c-4be5-994c-fc907eda73da admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:58.214628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3ba0-065c-4be5-994c-fc907eda73da admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:58.215333 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f3ba0-065c-4be5-994c-fc907eda73da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:58.217317 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f3ba0-065c-4be5-994c-fc907eda73da admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:58.241533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1050/2112] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:09:58 2021] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:09:58.242729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7580e-d1b2-4850-8554-22ba0ce351e2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:58.254695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f3ba0-065c-4be5-994c-fc907eda73da admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:58.256488 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-075f3ba0-065c-4be5-994c-fc907eda73da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:58.271899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7580e-d1b2-4850-8554-22ba0ce351e2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:58.277798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307db1-6897-4994-af0a-e68e5aeef28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:58.278858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307db1-6897-4994-af0a-e68e5aeef28c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:58.279194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307db1-6897-4994-af0a-e68e5aeef28c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:58.279491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307db1-6897-4994-af0a-e68e5aeef28c admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:58.281440 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9307db1-6897-4994-af0a-e68e5aeef28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:58.283500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9307db1-6897-4994-af0a-e68e5aeef28c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:58.302760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f3ba0-065c-4be5-994c-fc907eda73da admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:58.312081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1063/2113] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:58 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:58.313235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307db1-6897-4994-af0a-e68e5aeef28c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:58.314862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:58.315995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:58.316374 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:58.317865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] PATH_INFO: `/v3/users/d17a127504094f618b8b36d0b8ac405f` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:58.319887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17a127504094f618b8b36d0b8ac405f)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:58.322845 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:58.332988 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307db1-6897-4994-af0a-e68e5aeef28c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:58.339712 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656084a-0e47-4adf-93d2-6917e0555f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:58.340965 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656084a-0e47-4adf-93d2-6917e0555f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:58.341424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656084a-0e47-4adf-93d2-6917e0555f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:58.341872 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656084a-0e47-4adf-93d2-6917e0555f5c admin admin] PATH_INFO: `/v3/projects/bf239eeb9e08457e981da3e1f0943a7a/users/54a92a51bff1468ab022c03e531ecadf/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:58.363239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656084a-0e47-4adf-93d2-6917e0555f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf239eeb9e08457e981da3e1f0943a7a, user_id=54a92a51bff1468ab022c03e531ecadf, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:58.366225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656084a-0e47-4adf-93d2-6917e0555f5c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:58.389324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17a127504094f618b8b36d0b8ac405f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:58.404236 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17a127504094f618b8b36d0b8ac405f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:58.407642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1064/2114] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:58 2021] PUT /identity/v3/projects/bf239eeb9e08457e981da3e1f0943a7a/users/54a92a51bff1468ab022c03e531ecadf/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:58.408090 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17a127504094f618b8b36d0b8ac405f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:58.408090 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17a127504094f618b8b36d0b8ac405f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:58.413866 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656084a-0e47-4adf-93d2-6917e0555f5c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:58.427112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-3656084a-0e47-4adf-93d2-6917e0555f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:58.430600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17a127504094f618b8b36d0b8ac405f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:58.461316 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1051/2115] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:58 2021] DELETE /identity/v3/users/d17a127504094f618b8b36d0b8ac405f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:09:58.501726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:58.503495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:58.605251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656084a-0e47-4adf-93d2-6917e0555f5c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:58.652932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355bdb1-2d61-4e7d-b290-84ebdf1da77d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:58.659804 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:58.661052 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:58.661535 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:58.662183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] PATH_INFO: `/v3/projects/c58cceea327941d4ac25160a3941afb4` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:58.663866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58cceea327941d4ac25160a3941afb4)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:58.667593 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:58.739491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb949f5a-b698-4ae6-99a3-a53f1e955b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:58.740494 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb949f5a-b698-4ae6-99a3-a53f1e955b19 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:58.741157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb949f5a-b698-4ae6-99a3-a53f1e955b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:58.741437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb949f5a-b698-4ae6-99a3-a53f1e955b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:58.742193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb949f5a-b698-4ae6-99a3-a53f1e955b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:58.745675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58cceea327941d4ac25160a3941afb4', 'request_id': 'req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:58.749483 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb949f5a-b698-4ae6-99a3-a53f1e955b19 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:58.752346 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58cceea327941d4ac25160a3941afb4', 'request_id': 'req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:58.764617 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58cceea327941d4ac25160a3941afb4', 'request_id': 'req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:58.776155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1065/2116] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:09:58 2021] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:09:58.777049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb949f5a-b698-4ae6-99a3-a53f1e955b19 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:58.780436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-bb949f5a-b698-4ae6-99a3-a53f1e955b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:58.783014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] The token cache is being invalidate because project c58cceea327941d4ac25160a3941afb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:58.783310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:58.784032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:58.786734 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1052/2117] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:58 2021] DELETE /identity/v3/projects/c58cceea327941d4ac25160a3941afb4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:58.788040 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:58.789730 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:58.812260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb949f5a-b698-4ae6-99a3-a53f1e955b19 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:58.877678 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:58.878590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:58.878875 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:58.879156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] PATH_INFO: `/v3/projects/f0c87ba9f6794ec083b7527e3429b72d` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:58.880198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb50992-b0ca-4e7d-b752-79a2ffcf1f49 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:58.880401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c87ba9f6794ec083b7527e3429b72d)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:58.882521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:58.885701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb4ea9-a29f-4113-a4d3-c64041dcf747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:58.886632 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb4ea9-a29f-4113-a4d3-c64041dcf747 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:58.886954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb4ea9-a29f-4113-a4d3-c64041dcf747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:58.887242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb4ea9-a29f-4113-a4d3-c64041dcf747 admin admin] PATH_INFO: `/v3/projects/bf239eeb9e08457e981da3e1f0943a7a/users/54a92a51bff1468ab022c03e531ecadf/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:58.889270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb4ea9-a29f-4113-a4d3-c64041dcf747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf239eeb9e08457e981da3e1f0943a7a, user_id=54a92a51bff1468ab022c03e531ecadf, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:58.892435 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb4ea9-a29f-4113-a4d3-c64041dcf747 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:58.903863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1053/2118] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:09:58 2021] PUT /identity/v3/projects/bf239eeb9e08457e981da3e1f0943a7a/users/54a92a51bff1468ab022c03e531ecadf/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:58.912188 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb4ea9-a29f-4113-a4d3-c64041dcf747 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:58.914570 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8afb4ea9-a29f-4113-a4d3-c64041dcf747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:58.956515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c87ba9f6794ec083b7527e3429b72d', 'request_id': 'req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:58.972850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c87ba9f6794ec083b7527e3429b72d', 'request_id': 'req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:58.988424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c87ba9f6794ec083b7527e3429b72d', 'request_id': 'req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.001811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb4ea9-a29f-4113-a4d3-c64041dcf747 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:59.004205 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] The token cache is being invalidate because project f0c87ba9f6794ec083b7527e3429b72d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:59.004502 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.005534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.007029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1066/2119] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:58 2021] DELETE /identity/v3/projects/f0c87ba9f6794ec083b7527e3429b72d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:59.011861 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:59.013299 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:59.097560 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa26dc-e429-488f-96be-03afd0dd08f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:59.098631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa26dc-e429-488f-96be-03afd0dd08f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:59.098911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa26dc-e429-488f-96be-03afd0dd08f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:59.099215 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa26dc-e429-488f-96be-03afd0dd08f2 admin admin] PATH_INFO: `/v3/users/f40234984d6643b2a025b5cd10ea00aa` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:59.100756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa26dc-e429-488f-96be-03afd0dd08f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40234984d6643b2a025b5cd10ea00aa)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:59.103906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa26dc-e429-488f-96be-03afd0dd08f2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:59.109022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5fbcc-8937-4a1d-baa8-75d058feadc9 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:59.117944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:59.124644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:59.126035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:59.126035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] PATH_INFO: `/v3/users/63dffbff15ff4d4c82adf88258fcffac` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:59.127245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63dffbff15ff4d4c82adf88258fcffac)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:59.129433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:59.226326 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-34aa26dc-e429-488f-96be-03afd0dd08f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40234984d6643b2a025b5cd10ea00aa'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.231745 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63dffbff15ff4d4c82adf88258fcffac'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.232780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63dffbff15ff4d4c82adf88258fcffac'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.237254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-34aa26dc-e429-488f-96be-03afd0dd08f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40234984d6643b2a025b5cd10ea00aa'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.238521 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-34aa26dc-e429-488f-96be-03afd0dd08f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40234984d6643b2a025b5cd10ea00aa'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.239372 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-34aa26dc-e429-488f-96be-03afd0dd08f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40234984d6643b2a025b5cd10ea00aa'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.243041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63dffbff15ff4d4c82adf88258fcffac'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.245013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63dffbff15ff4d4c82adf88258fcffac'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.258627 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63dffbff15ff4d4c82adf88258fcffac'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.268373 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-34aa26dc-e429-488f-96be-03afd0dd08f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40234984d6643b2a025b5cd10ea00aa'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.290137 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1067/2120] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:59 2021] DELETE /identity/v3/users/63dffbff15ff4d4c82adf88258fcffac => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:59.297236 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1054/2121] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:09:58 2021] DELETE /identity/v3/users/f40234984d6643b2a025b5cd10ea00aa => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:59.634895 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:59.639325 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:59.724878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c126a06-3464-435b-a91c-10129d1a25f8 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:09:59.804195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:09:59.805089 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:59.807098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:59.807666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] PATH_INFO: `/v3/projects/e375f27d76b34600ab9f511990fc57c9` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:59.809420 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e375f27d76b34600ab9f511990fc57c9)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:09:59.812671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:09:59.891702 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e375f27d76b34600ab9f511990fc57c9', 'request_id': 'req-1d942a76-0117-4db3-ad6b-7130d9c84a49'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.898631 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e375f27d76b34600ab9f511990fc57c9', 'request_id': 'req-1d942a76-0117-4db3-ad6b-7130d9c84a49'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.910544 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e375f27d76b34600ab9f511990fc57c9', 'request_id': 'req-1d942a76-0117-4db3-ad6b-7130d9c84a49'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.932612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] The token cache is being invalidate because project e375f27d76b34600ab9f511990fc57c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:09:59.933358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.934649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:09:59.937304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1068/2122] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:59 2021] DELETE /identity/v3/projects/e375f27d76b34600ab9f511990fc57c9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:09:59.946583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a5f7-9149-47a2-b616-f8e52b638f26 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:09:59.951689 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a5f7-9149-47a2-b616-f8e52b638f26 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:09:59.954313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a5f7-9149-47a2-b616-f8e52b638f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:09:59.973171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:09:59.975570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:09:59.995480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-06b0a5f7-9149-47a2-b616-f8e52b638f26 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:09:59.997667 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-06b0a5f7-9149-47a2-b616-f8e52b638f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:00.101050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1055/2123] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:09:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:00.110356 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3780-27e0-4179-9a8b-cdc6dd843bed None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.116662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3780-27e0-4179-9a8b-cdc6dd843bed None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.117023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3780-27e0-4179-9a8b-cdc6dd843bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.119600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d942a76-0117-4db3-ad6b-7130d9c84a49 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:00.125271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:00.126943 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.127337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.127685 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef admin admin] PATH_INFO: `/v3/projects/cc58edda2f7445648d838e32912b6247` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.129188 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc58edda2f7445648d838e32912b6247)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:00.131425 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:00.140066 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-992f3780-27e0-4179-9a8b-cdc6dd843bed None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:00.141627 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-992f3780-27e0-4179-9a8b-cdc6dd843bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:00.153527 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1056/2124] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:00.161057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f3780-27e0-4179-9a8b-cdc6dd843bed None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:00.172116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f3780-27e0-4179-9a8b-cdc6dd843bed None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:00.177667 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006c4a5-62ab-430a-9c3f-3d39238e0244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:00.178334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006c4a5-62ab-430a-9c3f-3d39238e0244 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.178697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006c4a5-62ab-430a-9c3f-3d39238e0244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.178974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006c4a5-62ab-430a-9c3f-3d39238e0244 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.179833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006c4a5-62ab-430a-9c3f-3d39238e0244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:10:00.180171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006c4a5-62ab-430a-9c3f-3d39238e0244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:00.183439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006c4a5-62ab-430a-9c3f-3d39238e0244 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:00.207307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1057/2125] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:10:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:10:00.215996 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006c4a5-62ab-430a-9c3f-3d39238e0244 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:00.229841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006c4a5-62ab-430a-9c3f-3d39238e0244 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:00.235387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc58edda2f7445648d838e32912b6247', 'request_id': 'req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:00.242230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc58edda2f7445648d838e32912b6247', 'request_id': 'req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:00.253018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc58edda2f7445648d838e32912b6247', 'request_id': 'req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:00.267065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef admin admin] The token cache is being invalidate because project cc58edda2f7445648d838e32912b6247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:00.267356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:00.268171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4cf95a82-05d8-451e-9ef0-f99fd5c1d2ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:00.270398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1069/2126] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:09:59 2021] DELETE /identity/v3/projects/cc58edda2f7445648d838e32912b6247 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:00.279399 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7c1b6-7292-44a4-a673-f23fdf7ce275 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.280313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7c1b6-7292-44a4-a673-f23fdf7ce275 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.280838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7c1b6-7292-44a4-a673-f23fdf7ce275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.304711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-acc7c1b6-7292-44a4-a673-f23fdf7ce275 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:00.310936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-acc7c1b6-7292-44a4-a673-f23fdf7ce275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:00.339980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78c64f-5244-4068-b25d-f9ede961d1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:00.340752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78c64f-5244-4068-b25d-f9ede961d1bd admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.341108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78c64f-5244-4068-b25d-f9ede961d1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.341452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78c64f-5244-4068-b25d-f9ede961d1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.342238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78c64f-5244-4068-b25d-f9ede961d1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:00.345240 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78c64f-5244-4068-b25d-f9ede961d1bd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:00.410689 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1058/2127] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:00 2021] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:00.411531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78c64f-5244-4068-b25d-f9ede961d1bd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:00.419234 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-3b78c64f-5244-4068-b25d-f9ede961d1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:00.468720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1070/2128] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:00.486057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901d9f9-6887-4cae-a090-370de4bfe96d None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.486057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901d9f9-6887-4cae-a090-370de4bfe96d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.486414 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901d9f9-6887-4cae-a090-370de4bfe96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.526784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-f901d9f9-6887-4cae-a090-370de4bfe96d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:00.528289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f901d9f9-6887-4cae-a090-370de4bfe96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:00.575874 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78c64f-5244-4068-b25d-f9ede961d1bd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:00.582821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2b6e4-7905-46a0-80f4-fd4db8102ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:00.583531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2b6e4-7905-46a0-80f4-fd4db8102ebf admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.583821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2b6e4-7905-46a0-80f4-fd4db8102ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.586956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2b6e4-7905-46a0-80f4-fd4db8102ebf admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.586956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2b6e4-7905-46a0-80f4-fd4db8102ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:00.587998 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2b6e4-7905-46a0-80f4-fd4db8102ebf admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:00.616783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1071/2129] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:00.620176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901d9f9-6887-4cae-a090-370de4bfe96d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:00.631312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1059/2130] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:00 2021] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:00.635602 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2b6e4-7905-46a0-80f4-fd4db8102ebf admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:00.641104 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901d9f9-6887-4cae-a090-370de4bfe96d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:00.655102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2b6e4-7905-46a0-80f4-fd4db8102ebf admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:00.660879 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e7f15-38f8-4655-981e-34a7149356cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:00.661696 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e7f15-38f8-4655-981e-34a7149356cc admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.662083 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e7f15-38f8-4655-981e-34a7149356cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.663372 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e7f15-38f8-4655-981e-34a7149356cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.663372 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e7f15-38f8-4655-981e-34a7149356cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:00.664781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd2701-86e8-4901-8584-5b93f69788d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:00.665321 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e7f15-38f8-4655-981e-34a7149356cc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:00.666491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd2701-86e8-4901-8584-5b93f69788d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.667013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd2701-86e8-4901-8584-5b93f69788d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.667803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd2701-86e8-4901-8584-5b93f69788d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.668645 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd2701-86e8-4901-8584-5b93f69788d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:10:00.669064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd2701-86e8-4901-8584-5b93f69788d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:00.670758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd2701-86e8-4901-8584-5b93f69788d5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:00.679760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1060/2131] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:00 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:00.685192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1072/2132] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:10:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:10:00.685338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e7f15-38f8-4655-981e-34a7149356cc admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:00.688887 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd2701-86e8-4901-8584-5b93f69788d5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:00.695714 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e7f15-38f8-4655-981e-34a7149356cc admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:00.702707 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb2738-a82b-46dc-a8c2-89d9d479a669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:00.703746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb2738-a82b-46dc-a8c2-89d9d479a669 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.704406 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb2738-a82b-46dc-a8c2-89d9d479a669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.705270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb2738-a82b-46dc-a8c2-89d9d479a669 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.706764 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb2738-a82b-46dc-a8c2-89d9d479a669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:00.708574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb2738-a82b-46dc-a8c2-89d9d479a669 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:00.713617 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd2701-86e8-4901-8584-5b93f69788d5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:00.722576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1061/2133] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:00 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:00.726112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15680a6c-9d4f-4ede-bbab-36b31b36bd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:00.726298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb2738-a82b-46dc-a8c2-89d9d479a669 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:00.726975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680a6c-9d4f-4ede-bbab-36b31b36bd17 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.734884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680a6c-9d4f-4ede-bbab-36b31b36bd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.735286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680a6c-9d4f-4ede-bbab-36b31b36bd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.736298 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680a6c-9d4f-4ede-bbab-36b31b36bd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:00.737798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb2738-a82b-46dc-a8c2-89d9d479a669 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:00.738416 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680a6c-9d4f-4ede-bbab-36b31b36bd17 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:00.742680 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd49406-9188-4d71-aea5-f32ed50389b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:00.743789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd49406-9188-4d71-aea5-f32ed50389b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.744302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd49406-9188-4d71-aea5-f32ed50389b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.745674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd49406-9188-4d71-aea5-f32ed50389b2 admin admin] PATH_INFO: `/v3/projects/05d98ce960924e6889875055a4444add/users/aefd5bfb390c455aaee4c99f1714951a/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.762213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd49406-9188-4d71-aea5-f32ed50389b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d98ce960924e6889875055a4444add, user_id=aefd5bfb390c455aaee4c99f1714951a, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:00.765250 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd49406-9188-4d71-aea5-f32ed50389b2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:00.780811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1073/2134] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:00 2021] POST /identity/v3/projects => generated 403 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:00.783283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1062/2135] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:00 2021] PUT /identity/v3/projects/05d98ce960924e6889875055a4444add/users/aefd5bfb390c455aaee4c99f1714951a/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:00.785068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15680a6c-9d4f-4ede-bbab-36b31b36bd17 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:00.794592 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dd206-8fb8-44f4-8b56-a67223088bcc None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.795151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dd206-8fb8-44f4-8b56-a67223088bcc None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.795432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dd206-8fb8-44f4-8b56-a67223088bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.836036 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-113dd206-8fb8-44f4-8b56-a67223088bcc None None] MFA Rules not processed for user `aefd5bfb390c455aaee4c99f1714951a`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:00.839355 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-113dd206-8fb8-44f4-8b56-a67223088bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:00.876417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15680a6c-9d4f-4ede-bbab-36b31b36bd17 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:00.887396 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f2303-f100-4242-b570-98cf17fb137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:00.888195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f2303-f100-4242-b570-98cf17fb137d admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.888485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f2303-f100-4242-b570-98cf17fb137d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.888769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f2303-f100-4242-b570-98cf17fb137d admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.889492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f2303-f100-4242-b570-98cf17fb137d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:00.892223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f2303-f100-4242-b570-98cf17fb137d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:00.924480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1074/2136] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:00 2021] POST /identity/v3/users => generated 302 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:00.926621 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f2303-f100-4242-b570-98cf17fb137d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:00.944640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f2303-f100-4242-b570-98cf17fb137d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:00.952798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b618ca-1b81-4b97-9ddb-e2819c493d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:00.952798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b618ca-1b81-4b97-9ddb-e2819c493d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.952798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b618ca-1b81-4b97-9ddb-e2819c493d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:00.952798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b618ca-1b81-4b97-9ddb-e2819c493d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:00.953249 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b618ca-1b81-4b97-9ddb-e2819c493d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:00.954876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b618ca-1b81-4b97-9ddb-e2819c493d88 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:00.955003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1063/2137] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:00 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:10:00.956563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dd206-8fb8-44f4-8b56-a67223088bcc None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:00.976687 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1075/2138] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:00 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:10:00.976906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dd206-8fb8-44f4-8b56-a67223088bcc None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:00.978837 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b618ca-1b81-4b97-9ddb-e2819c493d88 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:00.993222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03967604-c286-49f9-85a9-6a67f755abf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:00.995112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03967604-c286-49f9-85a9-6a67f755abf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:00.999825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03967604-c286-49f9-85a9-6a67f755abf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:01.000587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03967604-c286-49f9-85a9-6a67f755abf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:01.000763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b618ca-1b81-4b97-9ddb-e2819c493d88 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:01.001547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03967604-c286-49f9-85a9-6a67f755abf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:01.010261 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669e2d2-8f79-4a00-8afd-eeeeb9586917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:01.011090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669e2d2-8f79-4a00-8afd-eeeeb9586917 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:01.011485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669e2d2-8f79-4a00-8afd-eeeeb9586917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:01.011840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669e2d2-8f79-4a00-8afd-eeeeb9586917 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:01.012183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03967604-c286-49f9-85a9-6a67f755abf7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:01.013638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669e2d2-8f79-4a00-8afd-eeeeb9586917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:01.015211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669e2d2-8f79-4a00-8afd-eeeeb9586917 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:01.032909 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1076/2139] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:00 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:10:01.035068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669e2d2-8f79-4a00-8afd-eeeeb9586917 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:01.047579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1064/2140] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:00 2021] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:01.047891 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03967604-c286-49f9-85a9-6a67f755abf7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:01.054180 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669e2d2-8f79-4a00-8afd-eeeeb9586917 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:01.139494 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368aa3fa-956f-46da-81d9-e8fa6bfdac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:01.139494 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aa3fa-956f-46da-81d9-e8fa6bfdac3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:01.139494 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aa3fa-956f-46da-81d9-e8fa6bfdac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:01.139897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aa3fa-956f-46da-81d9-e8fa6bfdac3f admin admin] PATH_INFO: `/v3/projects/02a9709abe394525b0d9adc12c4319cd/users/b5db6e80e4d5417692bdee0af2115947/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:01.156180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03967604-c286-49f9-85a9-6a67f755abf7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:01.163036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368aa3fa-956f-46da-81d9-e8fa6bfdac3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a9709abe394525b0d9adc12c4319cd, user_id=b5db6e80e4d5417692bdee0af2115947, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:01.167074 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368aa3fa-956f-46da-81d9-e8fa6bfdac3f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:01.172992 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb99ab7-ceed-4662-abec-5716f4c4a118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:01.173780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb99ab7-ceed-4662-abec-5716f4c4a118 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:01.174108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb99ab7-ceed-4662-abec-5716f4c4a118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:01.175740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb99ab7-ceed-4662-abec-5716f4c4a118 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:01.176507 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb99ab7-ceed-4662-abec-5716f4c4a118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:01.178599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb99ab7-ceed-4662-abec-5716f4c4a118 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:01.189789 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1077/2141] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:01 2021] PUT /identity/v3/projects/02a9709abe394525b0d9adc12c4319cd/users/b5db6e80e4d5417692bdee0af2115947/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:01.197963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b0174-7bff-4eee-91f2-7b34632522d3 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:01.199021 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b0174-7bff-4eee-91f2-7b34632522d3 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:01.199393 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b0174-7bff-4eee-91f2-7b34632522d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:01.212284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1065/2142] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:01 2021] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:01.213648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb99ab7-ceed-4662-abec-5716f4c4a118 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:01.221490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-092b0174-7bff-4eee-91f2-7b34632522d3 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:01.224096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-092b0174-7bff-4eee-91f2-7b34632522d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:01.226849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb99ab7-ceed-4662-abec-5716f4c4a118 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:01.304129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc73aa7-915b-48bf-add0-e3e0be0b5476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:01.304870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc73aa7-915b-48bf-add0-e3e0be0b5476 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:01.305325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc73aa7-915b-48bf-add0-e3e0be0b5476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:01.305443 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc73aa7-915b-48bf-add0-e3e0be0b5476 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:01.307149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc73aa7-915b-48bf-add0-e3e0be0b5476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:01.309040 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc73aa7-915b-48bf-add0-e3e0be0b5476 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:01.321661 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1078/2143] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:01.324107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1066/2144] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:01 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:01.333100 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b0174-7bff-4eee-91f2-7b34632522d3 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:01.333291 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc73aa7-915b-48bf-add0-e3e0be0b5476 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:01.335417 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-dfc73aa7-915b-48bf-add0-e3e0be0b5476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:01.349074 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b0174-7bff-4eee-91f2-7b34632522d3 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:01.356407 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7802d22-8814-4ee1-ad15-965a1e32726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:01.357451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7802d22-8814-4ee1-ad15-965a1e32726e admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:01.357839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7802d22-8814-4ee1-ad15-965a1e32726e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:01.358244 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7802d22-8814-4ee1-ad15-965a1e32726e admin admin] PATH_INFO: `/v3/projects/b96163cb2a324870a3a16d8b43d2ef0e/users/02b53f48313d4b71b0713f1792b23617/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:01.379055 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7802d22-8814-4ee1-ad15-965a1e32726e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96163cb2a324870a3a16d8b43d2ef0e, user_id=02b53f48313d4b71b0713f1792b23617, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:01.382101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7802d22-8814-4ee1-ad15-965a1e32726e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:01.407795 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1079/2145] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:01 2021] PUT /identity/v3/projects/b96163cb2a324870a3a16d8b43d2ef0e/users/02b53f48313d4b71b0713f1792b23617/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:01.409278 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7802d22-8814-4ee1-ad15-965a1e32726e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:01.440309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc73aa7-915b-48bf-add0-e3e0be0b5476 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:01.504343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7802d22-8814-4ee1-ad15-965a1e32726e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:01.521966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f71aec-54d2-4289-aaa2-35fbd9ba8441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:01.522920 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f71aec-54d2-4289-aaa2-35fbd9ba8441 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:01.523210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f71aec-54d2-4289-aaa2-35fbd9ba8441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:01.523653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f71aec-54d2-4289-aaa2-35fbd9ba8441 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:01.526515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f71aec-54d2-4289-aaa2-35fbd9ba8441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:01.528174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f71aec-54d2-4289-aaa2-35fbd9ba8441 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:01.550790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af7f03-1bf7-4f91-bad5-7fb4a29d5d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:01.550790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af7f03-1bf7-4f91-bad5-7fb4a29d5d58 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:01.550790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af7f03-1bf7-4f91-bad5-7fb4a29d5d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:01.550790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af7f03-1bf7-4f91-bad5-7fb4a29d5d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:01.561706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1080/2146] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:01 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:01.562974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f71aec-54d2-4289-aaa2-35fbd9ba8441 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:01.576688 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af7f03-1bf7-4f91-bad5-7fb4a29d5d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:01.578500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f71aec-54d2-4289-aaa2-35fbd9ba8441 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:01.580021 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af7f03-1bf7-4f91-bad5-7fb4a29d5d58 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:01.587000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd58b76-6c70-433e-8058-ebfaa2e8d1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:01.589549 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd58b76-6c70-433e-8058-ebfaa2e8d1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:01.590069 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd58b76-6c70-433e-8058-ebfaa2e8d1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:01.590655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd58b76-6c70-433e-8058-ebfaa2e8d1e1 admin admin] PATH_INFO: `/v3/projects/b96163cb2a324870a3a16d8b43d2ef0e/users/02b53f48313d4b71b0713f1792b23617/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:01.592445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1067/2147] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:01.601354 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd58b76-6c70-433e-8058-ebfaa2e8d1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96163cb2a324870a3a16d8b43d2ef0e, user_id=02b53f48313d4b71b0713f1792b23617, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:01.604780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd58b76-6c70-433e-8058-ebfaa2e8d1e1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:01.616779 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1081/2148] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:01 2021] PUT /identity/v3/projects/b96163cb2a324870a3a16d8b43d2ef0e/users/02b53f48313d4b71b0713f1792b23617/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:01.627589 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d4bec-8cab-4f61-bf15-fbd424d3aff2 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:01.628330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d4bec-8cab-4f61-bf15-fbd424d3aff2 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:01.628689 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d4bec-8cab-4f61-bf15-fbd424d3aff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:01.665297 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-040d4bec-8cab-4f61-bf15-fbd424d3aff2 None None] MFA Rules not processed for user `02b53f48313d4b71b0713f1792b23617`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:01.667134 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-040d4bec-8cab-4f61-bf15-fbd424d3aff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:01.760243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1068/2149] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:01 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:01.770255 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd58b76-6c70-433e-8058-ebfaa2e8d1e1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:01.772706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-3dd58b76-6c70-433e-8058-ebfaa2e8d1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:01.901359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd58b76-6c70-433e-8058-ebfaa2e8d1e1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:01.909836 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0543b-b5c3-4b73-a685-6658b01868bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:01.910723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0543b-b5c3-4b73-a685-6658b01868bc service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:01.911249 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0543b-b5c3-4b73-a685-6658b01868bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:01.911686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0543b-b5c3-4b73-a685-6658b01868bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:02.047630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0543b-b5c3-4b73-a685-6658b01868bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:02.050999 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0543b-b5c3-4b73-a685-6658b01868bc service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:02.071730 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1082/2150] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:01 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:02.968314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42790d0e-0aaa-480a-89d6-24e8e32f9c9f None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:02.968832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42790d0e-0aaa-480a-89d6-24e8e32f9c9f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:02.968946 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42790d0e-0aaa-480a-89d6-24e8e32f9c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:03.011897 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-42790d0e-0aaa-480a-89d6-24e8e32f9c9f None None] MFA Rules not processed for user `b5db6e80e4d5417692bdee0af2115947`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:03.013131 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-42790d0e-0aaa-480a-89d6-24e8e32f9c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:03.120853 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1069/2151] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:02 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:03.125453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0543b-b5c3-4b73-a685-6658b01868bc service cinder] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:03.253932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0543b-b5c3-4b73-a685-6658b01868bc service cinder] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:03.260579 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e88ee-c140-413c-8900-03dfab1318e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:03.261304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e88ee-c140-413c-8900-03dfab1318e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:03.261712 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e88ee-c140-413c-8900-03dfab1318e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:03.262266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e88ee-c140-413c-8900-03dfab1318e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:03.262968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e88ee-c140-413c-8900-03dfab1318e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:03.265281 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e88ee-c140-413c-8900-03dfab1318e9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:03.310832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1083/2152] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:03 2021] POST /identity/v3/projects => generated 403 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:03.314851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42790d0e-0aaa-480a-89d6-24e8e32f9c9f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:03.341351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42790d0e-0aaa-480a-89d6-24e8e32f9c9f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:03.425964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0f2e-65fe-4275-94e2-bc60d972511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:03.428928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0f2e-65fe-4275-94e2-bc60d972511d admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:03.428928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0f2e-65fe-4275-94e2-bc60d972511d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:03.428928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0f2e-65fe-4275-94e2-bc60d972511d admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:03.428928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa0f2e-65fe-4275-94e2-bc60d972511d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:03.430645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa0f2e-65fe-4275-94e2-bc60d972511d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:03.466774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1070/2153] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:03 2021] POST /identity/v3/users => generated 308 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:03.471181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e88ee-c140-413c-8900-03dfab1318e9 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:03.489986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e88ee-c140-413c-8900-03dfab1318e9 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:03.501271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581afe1f-055b-4ff7-8249-6fc4d7a816d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:03.501854 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581afe1f-055b-4ff7-8249-6fc4d7a816d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:03.502195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581afe1f-055b-4ff7-8249-6fc4d7a816d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:03.502524 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581afe1f-055b-4ff7-8249-6fc4d7a816d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:03.503252 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581afe1f-055b-4ff7-8249-6fc4d7a816d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:03.505076 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581afe1f-055b-4ff7-8249-6fc4d7a816d6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:03.528690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1084/2154] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:03 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:10:03.534041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0f2e-65fe-4275-94e2-bc60d972511d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:03.549226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0f2e-65fe-4275-94e2-bc60d972511d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:03.557160 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e615f4-1645-47a0-9d0e-35c9f3f03dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:03.560765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e615f4-1645-47a0-9d0e-35c9f3f03dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:03.561059 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e615f4-1645-47a0-9d0e-35c9f3f03dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:03.561347 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e615f4-1645-47a0-9d0e-35c9f3f03dd3 admin admin] PATH_INFO: `/v3/projects/2796afb0f28c49a097f80f25cbe03268/users/1b896964dca847feb3ea6f4a5f5539c0/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:03.586796 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e615f4-1645-47a0-9d0e-35c9f3f03dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2796afb0f28c49a097f80f25cbe03268, user_id=1b896964dca847feb3ea6f4a5f5539c0, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:03.590599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e615f4-1645-47a0-9d0e-35c9f3f03dd3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:03.616594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1071/2155] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:03 2021] PUT /identity/v3/projects/2796afb0f28c49a097f80f25cbe03268/users/1b896964dca847feb3ea6f4a5f5539c0/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:03.621755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581afe1f-055b-4ff7-8249-6fc4d7a816d6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:03.664855 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581afe1f-055b-4ff7-8249-6fc4d7a816d6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:03.787136 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348fe74-8445-4cf5-acb1-038736c5f95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:03.788038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348fe74-8445-4cf5-acb1-038736c5f95f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:03.788470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348fe74-8445-4cf5-acb1-038736c5f95f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:03.788913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348fe74-8445-4cf5-acb1-038736c5f95f admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:03.789906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348fe74-8445-4cf5-acb1-038736c5f95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:03.792018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348fe74-8445-4cf5-acb1-038736c5f95f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:03.803703 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1085/2156] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:03 2021] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:03.808927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e615f4-1645-47a0-9d0e-35c9f3f03dd3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:03.822321 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e615f4-1645-47a0-9d0e-35c9f3f03dd3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:03.838138 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aab70-54c4-4726-a29c-215af7d4b230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:03.839578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aab70-54c4-4726-a29c-215af7d4b230 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:03.839871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aab70-54c4-4726-a29c-215af7d4b230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:03.840153 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aab70-54c4-4726-a29c-215af7d4b230 admin admin] PATH_INFO: `/v3/projects/2796afb0f28c49a097f80f25cbe03268/users/1b896964dca847feb3ea6f4a5f5539c0/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:03.845629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58aab70-54c4-4726-a29c-215af7d4b230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2796afb0f28c49a097f80f25cbe03268, user_id=1b896964dca847feb3ea6f4a5f5539c0, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:03.860964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58aab70-54c4-4726-a29c-215af7d4b230 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:03.893134 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1072/2157] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:03 2021] PUT /identity/v3/projects/2796afb0f28c49a097f80f25cbe03268/users/1b896964dca847feb3ea6f4a5f5539c0/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:05.203563 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea7143-2f87-4be4-98d8-9d67169fbe23 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:05.204138 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea7143-2f87-4be4-98d8-9d67169fbe23 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:05.204280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea7143-2f87-4be4-98d8-9d67169fbe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:05.248357 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-efea7143-2f87-4be4-98d8-9d67169fbe23 None None] MFA Rules not processed for user `1b896964dca847feb3ea6f4a5f5539c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:05.250764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-efea7143-2f87-4be4-98d8-9d67169fbe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:05.380788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1086/2158] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:05 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:06.306451 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924634c-1553-4fb0-927d-7a59b3103d1f None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:06.307127 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924634c-1553-4fb0-927d-7a59b3103d1f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:06.307231 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924634c-1553-4fb0-927d-7a59b3103d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:06.336799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-0924634c-1553-4fb0-927d-7a59b3103d1f None None] MFA Rules not processed for user `54a92a51bff1468ab022c03e531ecadf`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:06.339091 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0924634c-1553-4fb0-927d-7a59b3103d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:06.460953 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1073/2159] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:06 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:10:06.475235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea7143-2f87-4be4-98d8-9d67169fbe23 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:06.477013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-efea7143-2f87-4be4-98d8-9d67169fbe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:06.619351 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea7143-2f87-4be4-98d8-9d67169fbe23 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:06.633036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d50bbc-1e68-4f04-908a-b05f759ddd9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d001733477f499e937ba90e7e50ba33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:06.633938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d50bbc-1e68-4f04-908a-b05f759ddd9b service glance] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:06.634394 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d50bbc-1e68-4f04-908a-b05f759ddd9b service glance] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:06.634751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d50bbc-1e68-4f04-908a-b05f759ddd9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:06.640820 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b3d50bbc-1e68-4f04-908a-b05f759ddd9b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:06.780783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d50bbc-1e68-4f04-908a-b05f759ddd9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:06.782266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d50bbc-1e68-4f04-908a-b05f759ddd9b service glance] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:06.802926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1087/2160] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:06 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:07.142771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924634c-1553-4fb0-927d-7a59b3103d1f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:07.144305 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0924634c-1553-4fb0-927d-7a59b3103d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:07.193866 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a73cc-a1f9-4c4f-bf30-9760d2d6041e None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:07.194448 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a73cc-a1f9-4c4f-bf30-9760d2d6041e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:07.194897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a73cc-a1f9-4c4f-bf30-9760d2d6041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:07.230939 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-853a73cc-a1f9-4c4f-bf30-9760d2d6041e None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:07.232326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-853a73cc-a1f9-4c4f-bf30-9760d2d6041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:07.267838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924634c-1553-4fb0-927d-7a59b3103d1f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:07.271626 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ccee2-5499-4c54-865b-bf977ee698a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:07.272295 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ccee2-5499-4c54-865b-bf977ee698a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:07.272582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ccee2-5499-4c54-865b-bf977ee698a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:07.272863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ccee2-5499-4c54-865b-bf977ee698a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:07.366486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1088/2161] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:10:07 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:07.437899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ccee2-5499-4c54-865b-bf977ee698a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:07.439634 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ccee2-5499-4c54-865b-bf977ee698a4 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:07.458267 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a73cc-a1f9-4c4f-bf30-9760d2d6041e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:07.460393 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-853a73cc-a1f9-4c4f-bf30-9760d2d6041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:07.461058 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1074/2162] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:07 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:07.629002 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a73cc-a1f9-4c4f-bf30-9760d2d6041e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:07.637114 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690fdd2-5977-433c-a42b-51400cd0824e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:07.637780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690fdd2-5977-433c-a42b-51400cd0824e service swift] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:07.638068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690fdd2-5977-433c-a42b-51400cd0824e service swift] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:07.638526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690fdd2-5977-433c-a42b-51400cd0824e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:07.652137 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690fdd2-5977-433c-a42b-51400cd0824e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:07.653856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690fdd2-5977-433c-a42b-51400cd0824e service swift] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:07.663083 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1089/2163] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:10:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 09 01:10:07.730115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ccee2-5499-4c54-865b-bf977ee698a4 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:07.833710 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ccee2-5499-4c54-865b-bf977ee698a4 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:07.858993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:07.860529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:07.860756 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:07.861095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] PATH_INFO: `/v3/users/b5db6e80e4d5417692bdee0af2115947` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:07.865137 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5db6e80e4d5417692bdee0af2115947)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:07.867833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:07.981310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5db6e80e4d5417692bdee0af2115947'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:07.992810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5db6e80e4d5417692bdee0af2115947'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:07.994598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5db6e80e4d5417692bdee0af2115947'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:07.995620 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5db6e80e4d5417692bdee0af2115947'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:08.012571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5db6e80e4d5417692bdee0af2115947'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:08.041017 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1075/2164] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:10:07 2021] DELETE /identity/v3/users/b5db6e80e4d5417692bdee0af2115947 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:08.327418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690fdd2-5977-433c-a42b-51400cd0824e service swift] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:08.345885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690fdd2-5977-433c-a42b-51400cd0824e service swift] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:08.503673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:08.505522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:08.506162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:08.506780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] PATH_INFO: `/v3/projects/02a9709abe394525b0d9adc12c4319cd` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:08.526665 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a9709abe394525b0d9adc12c4319cd)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:08.528856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:08.657040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a9709abe394525b0d9adc12c4319cd', 'request_id': 'req-2c0b9321-c3c6-4c03-97c2-6809e0b13106'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:08.686604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a9709abe394525b0d9adc12c4319cd', 'request_id': 'req-2c0b9321-c3c6-4c03-97c2-6809e0b13106'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:08.703788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a9709abe394525b0d9adc12c4319cd', 'request_id': 'req-2c0b9321-c3c6-4c03-97c2-6809e0b13106'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:08.726107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] The token cache is being invalidate because project 02a9709abe394525b0d9adc12c4319cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:08.726740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:08.727443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:08.729970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1090/2165] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:10:08 2021] DELETE /identity/v3/projects/02a9709abe394525b0d9adc12c4319cd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:08.734351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:08.736666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:08.755735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a53112-bb64-4db9-a111-f00249a7a9c4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:08.831506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74c7bc-b067-4fbf-8c48-29d6a384f68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:08.832329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74c7bc-b067-4fbf-8c48-29d6a384f68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:08.833221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74c7bc-b067-4fbf-8c48-29d6a384f68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:08.833508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74c7bc-b067-4fbf-8c48-29d6a384f68a admin admin] PATH_INFO: `/v3/users/1b896964dca847feb3ea6f4a5f5539c0` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:08.834881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74c7bc-b067-4fbf-8c48-29d6a384f68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b896964dca847feb3ea6f4a5f5539c0)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:08.836815 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74c7bc-b067-4fbf-8c48-29d6a384f68a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:08.947186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3d74c7bc-b067-4fbf-8c48-29d6a384f68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b896964dca847feb3ea6f4a5f5539c0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:08.968108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3d74c7bc-b067-4fbf-8c48-29d6a384f68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b896964dca847feb3ea6f4a5f5539c0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:08.971801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3d74c7bc-b067-4fbf-8c48-29d6a384f68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b896964dca847feb3ea6f4a5f5539c0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:08.974487 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3d74c7bc-b067-4fbf-8c48-29d6a384f68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b896964dca847feb3ea6f4a5f5539c0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:09.026044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3d74c7bc-b067-4fbf-8c48-29d6a384f68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b896964dca847feb3ea6f4a5f5539c0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:09.053782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1076/2166] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:10:08 2021] DELETE /identity/v3/users/1b896964dca847feb3ea6f4a5f5539c0 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:09.496601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:09.499313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:09.525970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b9321-c3c6-4c03-97c2-6809e0b13106 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:09.663203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7d753-a447-4703-b187-97e07031e5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:09.664139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7d753-a447-4703-b187-97e07031e5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:09.664464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7d753-a447-4703-b187-97e07031e5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:09.665231 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7d753-a447-4703-b187-97e07031e5f4 admin admin] PATH_INFO: `/v3/projects/2796afb0f28c49a097f80f25cbe03268` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:09.666874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7d753-a447-4703-b187-97e07031e5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2796afb0f28c49a097f80f25cbe03268)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:09.669498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7d753-a447-4703-b187-97e07031e5f4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:09.753769 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a1f7d753-a447-4703-b187-97e07031e5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2796afb0f28c49a097f80f25cbe03268', 'request_id': 'req-a1f7d753-a447-4703-b187-97e07031e5f4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:09.772711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a1f7d753-a447-4703-b187-97e07031e5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2796afb0f28c49a097f80f25cbe03268', 'request_id': 'req-a1f7d753-a447-4703-b187-97e07031e5f4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:09.785036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a1f7d753-a447-4703-b187-97e07031e5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2796afb0f28c49a097f80f25cbe03268', 'request_id': 'req-a1f7d753-a447-4703-b187-97e07031e5f4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:09.803806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a1f7d753-a447-4703-b187-97e07031e5f4 admin admin] The token cache is being invalidate because project 2796afb0f28c49a097f80f25cbe03268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:09.804065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a1f7d753-a447-4703-b187-97e07031e5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:09.804742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a1f7d753-a447-4703-b187-97e07031e5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:09.808066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1091/2167] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:10:09 2021] DELETE /identity/v3/projects/2796afb0f28c49a097f80f25cbe03268 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:09.813744 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11353-efe9-4895-8f2c-aee5f12b5917 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:09.814255 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11353-efe9-4895-8f2c-aee5f12b5917 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:09.814611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11353-efe9-4895-8f2c-aee5f12b5917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:09.863499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c7a11353-efe9-4895-8f2c-aee5f12b5917 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:09.865023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c7a11353-efe9-4895-8f2c-aee5f12b5917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:09.999286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1077/2168] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:10.000251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b972b-cf8c-4e74-a466-0d128677bc57 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:10.000638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b972b-cf8c-4e74-a466-0d128677bc57 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:10.001018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b972b-cf8c-4e74-a466-0d128677bc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:10.031311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-bb8b972b-cf8c-4e74-a466-0d128677bc57 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:10.033489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-bb8b972b-cf8c-4e74-a466-0d128677bc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:10.044743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1092/2169] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:10.048952 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a11353-efe9-4895-8f2c-aee5f12b5917 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:10.063587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a11353-efe9-4895-8f2c-aee5f12b5917 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:10.075485 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd534ec-527c-4dda-a809-2a2f87751d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:10.076170 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd534ec-527c-4dda-a809-2a2f87751d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:10.076454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd534ec-527c-4dda-a809-2a2f87751d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:10.076730 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd534ec-527c-4dda-a809-2a2f87751d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:10.077484 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd534ec-527c-4dda-a809-2a2f87751d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:10:10.077793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd534ec-527c-4dda-a809-2a2f87751d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:10.079465 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd534ec-527c-4dda-a809-2a2f87751d13 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:10.111514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1078/2170] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:10:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:10:10.114236 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b972b-cf8c-4e74-a466-0d128677bc57 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:10.128450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b972b-cf8c-4e74-a466-0d128677bc57 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:10.139454 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bbe63-cddc-4d93-ad6c-2c02cce5403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:10.140345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bbe63-cddc-4d93-ad6c-2c02cce5403a admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:10.141275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bbe63-cddc-4d93-ad6c-2c02cce5403a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:10.141658 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bbe63-cddc-4d93-ad6c-2c02cce5403a admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:10.142506 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bbe63-cddc-4d93-ad6c-2c02cce5403a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:10.159990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bbe63-cddc-4d93-ad6c-2c02cce5403a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:10.214190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1093/2171] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:10 2021] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:10.216025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd534ec-527c-4dda-a809-2a2f87751d13 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:10.229355 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd534ec-527c-4dda-a809-2a2f87751d13 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:10.358636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d7813-f574-4001-b8df-e4f48847e5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:10.359638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d7813-f574-4001-b8df-e4f48847e5de admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:10.359923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d7813-f574-4001-b8df-e4f48847e5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:10.360202 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d7813-f574-4001-b8df-e4f48847e5de admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:10.360981 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d7813-f574-4001-b8df-e4f48847e5de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:10.362899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d7813-f574-4001-b8df-e4f48847e5de admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:10.406482 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1079/2172] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:10 2021] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:10:10.410755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bbe63-cddc-4d93-ad6c-2c02cce5403a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:10.429529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bbe63-cddc-4d93-ad6c-2c02cce5403a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:10.442529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f066f-7eae-4124-b9b4-f455d06f4509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:10.443246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f066f-7eae-4124-b9b4-f455d06f4509 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:10.443536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f066f-7eae-4124-b9b4-f455d06f4509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:10.443817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f066f-7eae-4124-b9b4-f455d06f4509 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:10.444575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f066f-7eae-4124-b9b4-f455d06f4509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:10.449120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f066f-7eae-4124-b9b4-f455d06f4509 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:10.484765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1094/2173] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:10 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:10.488481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d7813-f574-4001-b8df-e4f48847e5de admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:10.506766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d7813-f574-4001-b8df-e4f48847e5de admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:10.517854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de600b4-ade3-4e73-a5e2-b1d101199384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:10.519421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de600b4-ade3-4e73-a5e2-b1d101199384 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:10.521698 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de600b4-ade3-4e73-a5e2-b1d101199384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:10.522053 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de600b4-ade3-4e73-a5e2-b1d101199384 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:10.522913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de600b4-ade3-4e73-a5e2-b1d101199384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:10.527608 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de600b4-ade3-4e73-a5e2-b1d101199384 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:10.542444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1080/2174] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:10 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:10.544832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f066f-7eae-4124-b9b4-f455d06f4509 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:10.559215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f066f-7eae-4124-b9b4-f455d06f4509 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:10.568283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb84be-6e65-4ee9-aaa7-1f4fa1e5b523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:10.569670 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb84be-6e65-4ee9-aaa7-1f4fa1e5b523 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:10.570140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb84be-6e65-4ee9-aaa7-1f4fa1e5b523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:10.570966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb84be-6e65-4ee9-aaa7-1f4fa1e5b523 admin admin] PATH_INFO: `/v3/projects/1832ccee65f64b05813db79f43cf5021/users/a8883951d5ef4c47a09a0d6f57230b7b/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:10.595531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb84be-6e65-4ee9-aaa7-1f4fa1e5b523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1832ccee65f64b05813db79f43cf5021, user_id=a8883951d5ef4c47a09a0d6f57230b7b, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:10.599004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb84be-6e65-4ee9-aaa7-1f4fa1e5b523 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:10.645086 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1095/2175] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:10 2021] PUT /identity/v3/projects/1832ccee65f64b05813db79f43cf5021/users/a8883951d5ef4c47a09a0d6f57230b7b/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:10.658044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c500d78-3260-45b5-98b6-0c375ec92722 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:10.658298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c500d78-3260-45b5-98b6-0c375ec92722 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:10.658619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c500d78-3260-45b5-98b6-0c375ec92722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:10.697392 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-9c500d78-3260-45b5-98b6-0c375ec92722 None None] MFA Rules not processed for user `a8883951d5ef4c47a09a0d6f57230b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:10.699328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9c500d78-3260-45b5-98b6-0c375ec92722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:10.828328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1081/2176] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:10 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:10.833316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb84be-6e65-4ee9-aaa7-1f4fa1e5b523 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:11.053190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb84be-6e65-4ee9-aaa7-1f4fa1e5b523 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:11.093653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818aca6-8b9a-421b-92a3-b4ea26eb7f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:11.094264 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818aca6-8b9a-421b-92a3-b4ea26eb7f41 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:11.097333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818aca6-8b9a-421b-92a3-b4ea26eb7f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:11.097619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818aca6-8b9a-421b-92a3-b4ea26eb7f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:11.098411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818aca6-8b9a-421b-92a3-b4ea26eb7f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:11.100732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818aca6-8b9a-421b-92a3-b4ea26eb7f41 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:11.190468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1096/2177] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:10 2021] POST /identity/v3/projects => generated 391 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:11.199550 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c500d78-3260-45b5-98b6-0c375ec92722 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:11.223692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c500d78-3260-45b5-98b6-0c375ec92722 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:11.351039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e196121-605c-492b-9752-e16f0433cd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:11.352220 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e196121-605c-492b-9752-e16f0433cd27 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:11.353585 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e196121-605c-492b-9752-e16f0433cd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:11.353944 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e196121-605c-492b-9752-e16f0433cd27 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:11.355061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e196121-605c-492b-9752-e16f0433cd27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:11.359076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e196121-605c-492b-9752-e16f0433cd27 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:11.437302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1082/2178] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:11 2021] POST /identity/v3/users => generated 302 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:11.438728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818aca6-8b9a-421b-92a3-b4ea26eb7f41 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:11.464224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818aca6-8b9a-421b-92a3-b4ea26eb7f41 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:11.482404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d986d1a-8652-4806-9c91-378b1df601c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:11.483917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d986d1a-8652-4806-9c91-378b1df601c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:11.484465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d986d1a-8652-4806-9c91-378b1df601c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:11.484957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d986d1a-8652-4806-9c91-378b1df601c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:11.496024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d986d1a-8652-4806-9c91-378b1df601c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:11.499790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d986d1a-8652-4806-9c91-378b1df601c4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:11.529365 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e196121-605c-492b-9752-e16f0433cd27 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:11.530854 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1097/2179] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:11 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:11.545099 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e196121-605c-492b-9752-e16f0433cd27 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:11.561655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79793d0-bb85-4eb1-b5cb-ff76ec7fdb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:11.562630 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79793d0-bb85-4eb1-b5cb-ff76ec7fdb44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:11.562912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79793d0-bb85-4eb1-b5cb-ff76ec7fdb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:11.563187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79793d0-bb85-4eb1-b5cb-ff76ec7fdb44 admin admin] PATH_INFO: `/v3/projects/cca696072005497db344b1a32f0c9874/users/dd579c820d6e495eb5ee82271bf7c57c/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:11.596477 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79793d0-bb85-4eb1-b5cb-ff76ec7fdb44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca696072005497db344b1a32f0c9874, user_id=dd579c820d6e495eb5ee82271bf7c57c, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:11.599278 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79793d0-bb85-4eb1-b5cb-ff76ec7fdb44 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:11.624536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1083/2180] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:11 2021] PUT /identity/v3/projects/cca696072005497db344b1a32f0c9874/users/dd579c820d6e495eb5ee82271bf7c57c/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:11.628591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d986d1a-8652-4806-9c91-378b1df601c4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:11.640584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d986d1a-8652-4806-9c91-378b1df601c4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:11.785335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7bbad-88b1-43ba-8741-44302fa59ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:11.785335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7bbad-88b1-43ba-8741-44302fa59ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:11.785335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7bbad-88b1-43ba-8741-44302fa59ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:11.785335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7bbad-88b1-43ba-8741-44302fa59ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:11.787057 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7bbad-88b1-43ba-8741-44302fa59ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:11.789310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7bbad-88b1-43ba-8741-44302fa59ea3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:11.827659 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1098/2181] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:11 2021] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:11.832059 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79793d0-bb85-4eb1-b5cb-ff76ec7fdb44 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:11.849785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79793d0-bb85-4eb1-b5cb-ff76ec7fdb44 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:11.871097 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b58c4-abb1-47b7-921e-daf19b2a6963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:11.873075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b58c4-abb1-47b7-921e-daf19b2a6963 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:11.873361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b58c4-abb1-47b7-921e-daf19b2a6963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:11.873640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b58c4-abb1-47b7-921e-daf19b2a6963 admin admin] PATH_INFO: `/v3/projects/cca696072005497db344b1a32f0c9874/users/dd579c820d6e495eb5ee82271bf7c57c/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:11.883140 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b58c4-abb1-47b7-921e-daf19b2a6963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca696072005497db344b1a32f0c9874, user_id=dd579c820d6e495eb5ee82271bf7c57c, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:11.887932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b58c4-abb1-47b7-921e-daf19b2a6963 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:11.906265 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1084/2182] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:11 2021] PUT /identity/v3/projects/cca696072005497db344b1a32f0c9874/users/dd579c820d6e495eb5ee82271bf7c57c/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:11.917480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc7617-7746-4133-9a00-2ca9b130415c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:11.917970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc7617-7746-4133-9a00-2ca9b130415c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:11.918080 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc7617-7746-4133-9a00-2ca9b130415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:11.977338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-51cc7617-7746-4133-9a00-2ca9b130415c None None] MFA Rules not processed for user `dd579c820d6e495eb5ee82271bf7c57c`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:11.979239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-51cc7617-7746-4133-9a00-2ca9b130415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:12.202439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1099/2183] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:11 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:12.234780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b58c4-abb1-47b7-921e-daf19b2a6963 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:12.236832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0e8b58c4-abb1-47b7-921e-daf19b2a6963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:12.434831 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b58c4-abb1-47b7-921e-daf19b2a6963 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:12.450332 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613ba4f-a5ee-412f-8ed1-9a6f9ac0db97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:12.451701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613ba4f-a5ee-412f-8ed1-9a6f9ac0db97 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:12.452145 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613ba4f-a5ee-412f-8ed1-9a6f9ac0db97 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:12.452612 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613ba4f-a5ee-412f-8ed1-9a6f9ac0db97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:12.468650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613ba4f-a5ee-412f-8ed1-9a6f9ac0db97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:12.472758 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613ba4f-a5ee-412f-8ed1-9a6f9ac0db97 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:12.494561 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1085/2184] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:12 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:12.624983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc7617-7746-4133-9a00-2ca9b130415c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:12.652075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc7617-7746-4133-9a00-2ca9b130415c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:12.658283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a31e7c-5397-4029-b2d3-e03319fb17ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:12.659993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a31e7c-5397-4029-b2d3-e03319fb17ce service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:12.661006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a31e7c-5397-4029-b2d3-e03319fb17ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:12.661708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a31e7c-5397-4029-b2d3-e03319fb17ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:12.758193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a31e7c-5397-4029-b2d3-e03319fb17ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:12.760999 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a31e7c-5397-4029-b2d3-e03319fb17ce service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:12.775654 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1100/2185] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:12 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:13.359624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613ba4f-a5ee-412f-8ed1-9a6f9ac0db97 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:13.361349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f613ba4f-a5ee-412f-8ed1-9a6f9ac0db97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:13.538575 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613ba4f-a5ee-412f-8ed1-9a6f9ac0db97 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:13.551081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:13.552323 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:13.552768 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:13.553235 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] PATH_INFO: `/v3/users/aefd5bfb390c455aaee4c99f1714951a` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:13.554967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aefd5bfb390c455aaee4c99f1714951a)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:13.557490 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:13.627403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aefd5bfb390c455aaee4c99f1714951a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:13.636083 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aefd5bfb390c455aaee4c99f1714951a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:13.637121 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aefd5bfb390c455aaee4c99f1714951a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:13.638003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aefd5bfb390c455aaee4c99f1714951a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:13.668428 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aefd5bfb390c455aaee4c99f1714951a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:13.695835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1086/2186] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:10:13 2021] DELETE /identity/v3/users/aefd5bfb390c455aaee4c99f1714951a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:13.702866 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ad310-79c8-4fd5-a877-dd323d920e6c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:13.704180 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ad310-79c8-4fd5-a877-dd323d920e6c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:13.704683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ad310-79c8-4fd5-a877-dd323d920e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:13.759890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-820ad310-79c8-4fd5-a877-dd323d920e6c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:13.761490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-820ad310-79c8-4fd5-a877-dd323d920e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:13.860633 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1101/2187] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:13.885175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:13.886702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:14.023856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21865231-0868-41ef-842b-a6102f079f39 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:14.030161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b1fea-4e13-45a4-8834-85cdae35d51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:14.031623 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b1fea-4e13-45a4-8834-85cdae35d51c service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:14.032043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b1fea-4e13-45a4-8834-85cdae35d51c service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:14.032397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b1fea-4e13-45a4-8834-85cdae35d51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:14.048219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b1fea-4e13-45a4-8834-85cdae35d51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:14.049746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b1fea-4e13-45a4-8834-85cdae35d51c service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:14.062463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1087/2188] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:14.533983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ad310-79c8-4fd5-a877-dd323d920e6c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:14.535504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-820ad310-79c8-4fd5-a877-dd323d920e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:14.561195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ad310-79c8-4fd5-a877-dd323d920e6c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:14.591072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:14.591955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:14.592235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:14.592512 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] PATH_INFO: `/v3/projects/05d98ce960924e6889875055a4444add` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:14.594466 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d98ce960924e6889875055a4444add)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:14.596651 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:14.709421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d98ce960924e6889875055a4444add', 'request_id': 'req-30f5e913-cd74-44ec-8877-9f8e92cffbd8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:14.724434 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d98ce960924e6889875055a4444add', 'request_id': 'req-30f5e913-cd74-44ec-8877-9f8e92cffbd8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:14.747767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d98ce960924e6889875055a4444add', 'request_id': 'req-30f5e913-cd74-44ec-8877-9f8e92cffbd8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:14.770491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] The token cache is being invalidate because project 05d98ce960924e6889875055a4444add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:14.771655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:14.773245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:14.777077 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1102/2189] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:10:14 2021] DELETE /identity/v3/projects/05d98ce960924e6889875055a4444add => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:14.781084 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b1fea-4e13-45a4-8834-85cdae35d51c service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:14.795908 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b1fea-4e13-45a4-8834-85cdae35d51c service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:14.914692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff697f-58d9-4b4c-a9ad-9d74048d2d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:14.915976 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff697f-58d9-4b4c-a9ad-9d74048d2d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:14.916334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff697f-58d9-4b4c-a9ad-9d74048d2d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:14.916706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff697f-58d9-4b4c-a9ad-9d74048d2d8d admin admin] PATH_INFO: `/v3/users/02b53f48313d4b71b0713f1792b23617` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:14.918552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff697f-58d9-4b4c-a9ad-9d74048d2d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b53f48313d4b71b0713f1792b23617)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:14.920777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff697f-58d9-4b4c-a9ad-9d74048d2d8d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:14.995720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-70ff697f-58d9-4b4c-a9ad-9d74048d2d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b53f48313d4b71b0713f1792b23617'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:15.004182 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-70ff697f-58d9-4b4c-a9ad-9d74048d2d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b53f48313d4b71b0713f1792b23617'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:15.004968 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-70ff697f-58d9-4b4c-a9ad-9d74048d2d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b53f48313d4b71b0713f1792b23617'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:15.005587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-70ff697f-58d9-4b4c-a9ad-9d74048d2d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b53f48313d4b71b0713f1792b23617'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:15.028639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-70ff697f-58d9-4b4c-a9ad-9d74048d2d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b53f48313d4b71b0713f1792b23617'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:15.053657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1088/2190] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:10:14 2021] DELETE /identity/v3/users/02b53f48313d4b71b0713f1792b23617 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:15.484522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:15.486014 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:15.507097 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5e913-cd74-44ec-8877-9f8e92cffbd8 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:15.597646 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:15.598605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:15.598894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:15.599180 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2 admin admin] PATH_INFO: `/v3/projects/b96163cb2a324870a3a16d8b43d2ef0e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:15.603583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96163cb2a324870a3a16d8b43d2ef0e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:15.606242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:15.666731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96163cb2a324870a3a16d8b43d2ef0e', 'request_id': 'req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:15.673522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96163cb2a324870a3a16d8b43d2ef0e', 'request_id': 'req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:15.684110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96163cb2a324870a3a16d8b43d2ef0e', 'request_id': 'req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:15.698711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2 admin admin] The token cache is being invalidate because project b96163cb2a324870a3a16d8b43d2ef0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:15.699273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:15.702139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d1cb40d9-6f7b-4dec-b6c0-6866d5f7afb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:15.704703 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1103/2191] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:10:15 2021] DELETE /identity/v3/projects/b96163cb2a324870a3a16d8b43d2ef0e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:15.712518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ed9c1-fa4c-41df-9950-34b5cea0f10b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:15.713566 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ed9c1-fa4c-41df-9950-34b5cea0f10b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:15.714011 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ed9c1-fa4c-41df-9950-34b5cea0f10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:15.736037 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-955ed9c1-fa4c-41df-9950-34b5cea0f10b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:15.737493 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-955ed9c1-fa4c-41df-9950-34b5cea0f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:15.832015 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1089/2192] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:15.834619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396031-05b8-41de-992e-e6f8df49ae9e None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:15.835344 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396031-05b8-41de-992e-e6f8df49ae9e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:15.835786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396031-05b8-41de-992e-e6f8df49ae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:15.860805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2e396031-05b8-41de-992e-e6f8df49ae9e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:15.863012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2e396031-05b8-41de-992e-e6f8df49ae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:15.876081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1104/2193] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:15.880385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ed9c1-fa4c-41df-9950-34b5cea0f10b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:15.890394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ed9c1-fa4c-41df-9950-34b5cea0f10b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:15.895553 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628800-6fbf-4410-8e0b-f3afdcd0aa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:15.896693 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628800-6fbf-4410-8e0b-f3afdcd0aa60 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:15.897211 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628800-6fbf-4410-8e0b-f3afdcd0aa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:15.897716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628800-6fbf-4410-8e0b-f3afdcd0aa60 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:15.898666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628800-6fbf-4410-8e0b-f3afdcd0aa60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:10:15.899082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628800-6fbf-4410-8e0b-f3afdcd0aa60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:15.901497 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628800-6fbf-4410-8e0b-f3afdcd0aa60 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:15.914349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1090/2194] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:10:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:10:15.920176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396031-05b8-41de-992e-e6f8df49ae9e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:15.931526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396031-05b8-41de-992e-e6f8df49ae9e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:15.938228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb74a35-a470-400b-9a35-3f484009398e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:15.939047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb74a35-a470-400b-9a35-3f484009398e admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:15.939433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb74a35-a470-400b-9a35-3f484009398e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:15.939812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb74a35-a470-400b-9a35-3f484009398e admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:15.940628 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb74a35-a470-400b-9a35-3f484009398e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:15.942664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb74a35-a470-400b-9a35-3f484009398e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:16.000759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1105/2195] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:15 2021] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:10:16.002794 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628800-6fbf-4410-8e0b-f3afdcd0aa60 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:16.016909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628800-6fbf-4410-8e0b-f3afdcd0aa60 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:16.141958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f271d-a8d2-4540-90e6-60efd413b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:16.142702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f271d-a8d2-4540-90e6-60efd413b043 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:16.142991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f271d-a8d2-4540-90e6-60efd413b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:16.143272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f271d-a8d2-4540-90e6-60efd413b043 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:16.144014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f271d-a8d2-4540-90e6-60efd413b043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:16.146303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f271d-a8d2-4540-90e6-60efd413b043 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:16.178396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1091/2196] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:16 2021] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:16.183773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb74a35-a470-400b-9a35-3f484009398e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:16.200150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb74a35-a470-400b-9a35-3f484009398e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:16.209868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47368-957f-46a1-af3a-e88c006f008e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:16.210797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47368-957f-46a1-af3a-e88c006f008e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:16.211284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47368-957f-46a1-af3a-e88c006f008e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:16.211633 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47368-957f-46a1-af3a-e88c006f008e admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:16.213229 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f47368-957f-46a1-af3a-e88c006f008e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:16.214987 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f47368-957f-46a1-af3a-e88c006f008e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:16.230509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1106/2197] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:16 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:16.231537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f271d-a8d2-4540-90e6-60efd413b043 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:16.245698 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f271d-a8d2-4540-90e6-60efd413b043 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:16.251840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f18c97-d7bc-4771-a2a6-cc4bf3b13d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:16.253188 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f18c97-d7bc-4771-a2a6-cc4bf3b13d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:16.253188 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f18c97-d7bc-4771-a2a6-cc4bf3b13d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:16.253188 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f18c97-d7bc-4771-a2a6-cc4bf3b13d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:16.253537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f18c97-d7bc-4771-a2a6-cc4bf3b13d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:16.255212 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f18c97-d7bc-4771-a2a6-cc4bf3b13d5b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:16.276505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1092/2198] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:16 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:10:16.289368 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47368-957f-46a1-af3a-e88c006f008e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:16.310940 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47368-957f-46a1-af3a-e88c006f008e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:16.316508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b66d7-30f4-4760-ab2d-5ea1063e1544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:16.317583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b66d7-30f4-4760-ab2d-5ea1063e1544 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:16.326897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b66d7-30f4-4760-ab2d-5ea1063e1544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:16.327204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b66d7-30f4-4760-ab2d-5ea1063e1544 admin admin] PATH_INFO: `/v3/projects/ef190f8b2e3e48bd96c0988046d2de78/users/54f07f57f3fc4be5b1debc865af04ff4/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:16.349220 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b66d7-30f4-4760-ab2d-5ea1063e1544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef190f8b2e3e48bd96c0988046d2de78, user_id=54f07f57f3fc4be5b1debc865af04ff4, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:16.351892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b66d7-30f4-4760-ab2d-5ea1063e1544 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:16.382905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1107/2199] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:16 2021] PUT /identity/v3/projects/ef190f8b2e3e48bd96c0988046d2de78/users/54f07f57f3fc4be5b1debc865af04ff4/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:16.387692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f70f58-feb4-406b-86cb-c462184592f6 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:16.387984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f70f58-feb4-406b-86cb-c462184592f6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:16.388261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f70f58-feb4-406b-86cb-c462184592f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:16.420186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e7f70f58-feb4-406b-86cb-c462184592f6 None None] MFA Rules not processed for user `54f07f57f3fc4be5b1debc865af04ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:16.421426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e7f70f58-feb4-406b-86cb-c462184592f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:16.492886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1093/2200] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:16 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:16.506301 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b66d7-30f4-4760-ab2d-5ea1063e1544 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:16.509467 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e39b66d7-30f4-4760-ab2d-5ea1063e1544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:16.570093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b66d7-30f4-4760-ab2d-5ea1063e1544 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:16.575060 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ddc4b-9cd5-479f-8d93-854a94047275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:16.575712 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ddc4b-9cd5-479f-8d93-854a94047275 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:16.575992 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ddc4b-9cd5-479f-8d93-854a94047275 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:16.576274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ddc4b-9cd5-479f-8d93-854a94047275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:16.585298 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ddc4b-9cd5-479f-8d93-854a94047275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:16.587482 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ddc4b-9cd5-479f-8d93-854a94047275 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:16.597884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1108/2201] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:16 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:16.620563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f70f58-feb4-406b-86cb-c462184592f6 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:16.692275 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f70f58-feb4-406b-86cb-c462184592f6 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:16.697538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:16.698445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:16.698958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:16.698958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] PATH_INFO: `/v3/users/54f07f57f3fc4be5b1debc865af04ff4` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:16.700905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f07f57f3fc4be5b1debc865af04ff4)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:16.702862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:16.776083 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f07f57f3fc4be5b1debc865af04ff4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:16.792039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f07f57f3fc4be5b1debc865af04ff4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:16.792919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f07f57f3fc4be5b1debc865af04ff4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:16.793530 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f07f57f3fc4be5b1debc865af04ff4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:16.810925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f07f57f3fc4be5b1debc865af04ff4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:16.837201 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1094/2202] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:10:16 2021] DELETE /identity/v3/users/54f07f57f3fc4be5b1debc865af04ff4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:16.842632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928ceae-56f8-43b5-bf3b-16e8f9d2a6ae None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:16.842632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928ceae-56f8-43b5-bf3b-16e8f9d2a6ae None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:16.842632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928ceae-56f8-43b5-bf3b-16e8f9d2a6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:16.868926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-5928ceae-56f8-43b5-bf3b-16e8f9d2a6ae None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:16.870111 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5928ceae-56f8-43b5-bf3b-16e8f9d2a6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:17.008638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1109/2203] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:17.015616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:17.019238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:17.031346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928ceae-56f8-43b5-bf3b-16e8f9d2a6ae None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:17.033142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5928ceae-56f8-43b5-bf3b-16e8f9d2a6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:17.040259 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f7595-1680-493f-94b3-953821aeead0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:17.046314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed44c16-92a5-4fe3-a83e-a3cd9dbc67ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:17.047259 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed44c16-92a5-4fe3-a83e-a3cd9dbc67ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:17.047542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed44c16-92a5-4fe3-a83e-a3cd9dbc67ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:17.047819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed44c16-92a5-4fe3-a83e-a3cd9dbc67ed admin admin] PATH_INFO: `/v3/users/a8883951d5ef4c47a09a0d6f57230b7b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:17.049982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed44c16-92a5-4fe3-a83e-a3cd9dbc67ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8883951d5ef4c47a09a0d6f57230b7b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:17.053609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed44c16-92a5-4fe3-a83e-a3cd9dbc67ed admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:17.162656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-fed44c16-92a5-4fe3-a83e-a3cd9dbc67ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8883951d5ef4c47a09a0d6f57230b7b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:17.166084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928ceae-56f8-43b5-bf3b-16e8f9d2a6ae None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:17.176088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7faae3-19f5-42a6-a099-69b556f218f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:17.177353 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7faae3-19f5-42a6-a099-69b556f218f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:17.177641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7faae3-19f5-42a6-a099-69b556f218f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:17.179035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-fed44c16-92a5-4fe3-a83e-a3cd9dbc67ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8883951d5ef4c47a09a0d6f57230b7b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:17.179646 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7faae3-19f5-42a6-a099-69b556f218f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:17.180285 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-fed44c16-92a5-4fe3-a83e-a3cd9dbc67ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8883951d5ef4c47a09a0d6f57230b7b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:17.181392 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-fed44c16-92a5-4fe3-a83e-a3cd9dbc67ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8883951d5ef4c47a09a0d6f57230b7b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:17.184063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-4a7faae3-19f5-42a6-a099-69b556f218f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:17.206900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-fed44c16-92a5-4fe3-a83e-a3cd9dbc67ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8883951d5ef4c47a09a0d6f57230b7b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:17.224403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7faae3-19f5-42a6-a099-69b556f218f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:17.225514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1095/2204] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:10:17 2021] DELETE /identity/v3/users/a8883951d5ef4c47a09a0d6f57230b7b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:17.226044 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7faae3-19f5-42a6-a099-69b556f218f4 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:17.230430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5210b68-fffb-4b95-a2f8-a0b8560ec682 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:17.230763 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5210b68-fffb-4b95-a2f8-a0b8560ec682 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:17.231199 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5210b68-fffb-4b95-a2f8-a0b8560ec682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:17.255902 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d5210b68-fffb-4b95-a2f8-a0b8560ec682 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:17.257467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d5210b68-fffb-4b95-a2f8-a0b8560ec682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:17.259825 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1110/2205] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:17.418615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1096/2206] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:17.429874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7faae3-19f5-42a6-a099-69b556f218f4 service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:17.432219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-4a7faae3-19f5-42a6-a099-69b556f218f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:17.464530 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7faae3-19f5-42a6-a099-69b556f218f4 service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:17.547106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fb0ae-d71c-46cb-aac1-749b3ef5c60b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:17.547994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fb0ae-d71c-46cb-aac1-749b3ef5c60b service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:17.548344 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fb0ae-d71c-46cb-aac1-749b3ef5c60b service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:17.548615 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fb0ae-d71c-46cb-aac1-749b3ef5c60b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:17.576947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fb0ae-d71c-46cb-aac1-749b3ef5c60b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:17.579758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fb0ae-d71c-46cb-aac1-749b3ef5c60b service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:17.595169 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1111/2207] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:17.816596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5210b68-fffb-4b95-a2f8-a0b8560ec682 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:17.818036 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d5210b68-fffb-4b95-a2f8-a0b8560ec682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:17.831081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5210b68-fffb-4b95-a2f8-a0b8560ec682 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:17.838192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db63f5-079b-477c-a4fb-4a18487972fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:17.839826 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db63f5-079b-477c-a4fb-4a18487972fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:17.840774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db63f5-079b-477c-a4fb-4a18487972fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:17.841175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db63f5-079b-477c-a4fb-4a18487972fa admin admin] PATH_INFO: `/v3/projects/ef190f8b2e3e48bd96c0988046d2de78` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:17.842615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db63f5-079b-477c-a4fb-4a18487972fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef190f8b2e3e48bd96c0988046d2de78)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:17.844866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db63f5-079b-477c-a4fb-4a18487972fa admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:17.912858 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-80db63f5-079b-477c-a4fb-4a18487972fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef190f8b2e3e48bd96c0988046d2de78', 'request_id': 'req-80db63f5-079b-477c-a4fb-4a18487972fa'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:17.918555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-80db63f5-079b-477c-a4fb-4a18487972fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef190f8b2e3e48bd96c0988046d2de78', 'request_id': 'req-80db63f5-079b-477c-a4fb-4a18487972fa'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:17.928090 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-80db63f5-079b-477c-a4fb-4a18487972fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef190f8b2e3e48bd96c0988046d2de78', 'request_id': 'req-80db63f5-079b-477c-a4fb-4a18487972fa'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:17.946862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-80db63f5-079b-477c-a4fb-4a18487972fa admin admin] The token cache is being invalidate because project ef190f8b2e3e48bd96c0988046d2de78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:17.947219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-80db63f5-079b-477c-a4fb-4a18487972fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:17.947833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-80db63f5-079b-477c-a4fb-4a18487972fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:17.950421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1097/2208] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:10:17 2021] DELETE /identity/v3/projects/ef190f8b2e3e48bd96c0988046d2de78 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:17.955833 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac874cd-ec20-4d85-a1b6-0d2440317cb6 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:17.956349 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac874cd-ec20-4d85-a1b6-0d2440317cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:17.956838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac874cd-ec20-4d85-a1b6-0d2440317cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:17.980667 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-5ac874cd-ec20-4d85-a1b6-0d2440317cb6 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:17.981872 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5ac874cd-ec20-4d85-a1b6-0d2440317cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:18.152218 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1112/2209] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:18.156937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cdf8e-d4cf-4158-adfe-45bbb731407a None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:18.157562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cdf8e-d4cf-4158-adfe-45bbb731407a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:18.157914 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cdf8e-d4cf-4158-adfe-45bbb731407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:18.187907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac874cd-ec20-4d85-a1b6-0d2440317cb6 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:18.198882 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5ac874cd-ec20-4d85-a1b6-0d2440317cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:18.211313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c68cdf8e-d4cf-4158-adfe-45bbb731407a None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:18.215679 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c68cdf8e-d4cf-4158-adfe-45bbb731407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:18.224274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac874cd-ec20-4d85-a1b6-0d2440317cb6 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:18.231674 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:18.232840 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:18.233195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:18.233534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] PATH_INFO: `/v3/projects/1832ccee65f64b05813db79f43cf5021` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:18.235120 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1098/2210] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:18.235588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1832ccee65f64b05813db79f43cf5021)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:18.239188 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:18.239688 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cdf8e-d4cf-4158-adfe-45bbb731407a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:18.258432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cdf8e-d4cf-4158-adfe-45bbb731407a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:18.258432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7e473-1ef8-443b-89c7-1e0512b4747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:18.258432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7e473-1ef8-443b-89c7-1e0512b4747f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:18.258432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7e473-1ef8-443b-89c7-1e0512b4747f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:18.259458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7e473-1ef8-443b-89c7-1e0512b4747f admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:18.259458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7e473-1ef8-443b-89c7-1e0512b4747f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:10:18.259458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7e473-1ef8-443b-89c7-1e0512b4747f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:18.259458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7e473-1ef8-443b-89c7-1e0512b4747f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:18.302055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1099/2211] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:10:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 01:10:18.307769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7e473-1ef8-443b-89c7-1e0512b4747f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:18.336235 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7e473-1ef8-443b-89c7-1e0512b4747f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:18.352428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1832ccee65f64b05813db79f43cf5021', 'request_id': 'req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:18.360585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1832ccee65f64b05813db79f43cf5021', 'request_id': 'req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:18.369734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1832ccee65f64b05813db79f43cf5021', 'request_id': 'req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:18.392522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] The token cache is being invalidate because project 1832ccee65f64b05813db79f43cf5021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:18.392892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:18.393761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:18.396178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1113/2212] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:10:18 2021] DELETE /identity/v3/projects/1832ccee65f64b05813db79f43cf5021 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:18.399543 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:18.400367 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f582d2-7bb2-4ed9-b744-3d99191c7ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:18.401031 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f582d2-7bb2-4ed9-b744-3d99191c7ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:18.401156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:18.401307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f582d2-7bb2-4ed9-b744-3d99191c7ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:18.401587 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f582d2-7bb2-4ed9-b744-3d99191c7ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:18.402400 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f582d2-7bb2-4ed9-b744-3d99191c7ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:18.404248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f582d2-7bb2-4ed9-b744-3d99191c7ac7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:18.437750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9daf9-9cc7-45ad-85e5-d9d77b5732f3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:18.451190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:18.453604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:18.453894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:18.454877 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] PATH_INFO: `/v3/users/dd579c820d6e495eb5ee82271bf7c57c` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:18.457571 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd579c820d6e495eb5ee82271bf7c57c)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:18.461269 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:18.461579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1100/2213] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:18 2021] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:10:18.466377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f582d2-7bb2-4ed9-b744-3d99191c7ac7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:18.468940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a0f582d2-7bb2-4ed9-b744-3d99191c7ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:18.560166 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd579c820d6e495eb5ee82271bf7c57c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:18.561250 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd579c820d6e495eb5ee82271bf7c57c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:18.569539 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd579c820d6e495eb5ee82271bf7c57c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:18.570180 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd579c820d6e495eb5ee82271bf7c57c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:18.587746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f582d2-7bb2-4ed9-b744-3d99191c7ac7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:18.603770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898269ba-d561-44ad-8461-03756428fb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:18.604684 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898269ba-d561-44ad-8461-03756428fb95 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:18.605043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898269ba-d561-44ad-8461-03756428fb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:18.605396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898269ba-d561-44ad-8461-03756428fb95 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:18.606109 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898269ba-d561-44ad-8461-03756428fb95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:18.606499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd579c820d6e495eb5ee82271bf7c57c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:18.608253 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898269ba-d561-44ad-8461-03756428fb95 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:18.625870 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1114/2214] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:10:18 2021] DELETE /identity/v3/users/dd579c820d6e495eb5ee82271bf7c57c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:18.632315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1101/2215] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:18 2021] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:10:18.637234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:18.638823 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:18.729451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aaf51-347f-494d-a061-79cba0de414b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:18.738894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefa466-655f-4a3c-97ab-bd158ca3d732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:18.739771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefa466-655f-4a3c-97ab-bd158ca3d732 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:18.740182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefa466-655f-4a3c-97ab-bd158ca3d732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:18.740601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefa466-655f-4a3c-97ab-bd158ca3d732 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:18.741457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefa466-655f-4a3c-97ab-bd158ca3d732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:18.743362 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefa466-655f-4a3c-97ab-bd158ca3d732 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:18.763505 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1115/2216] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:18 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:18.769245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898269ba-d561-44ad-8461-03756428fb95 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:18.784665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898269ba-d561-44ad-8461-03756428fb95 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:18.807544 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d94410-393c-4650-81d4-be7c7cd0e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:18.808232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d94410-393c-4650-81d4-be7c7cd0e28f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:18.808511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d94410-393c-4650-81d4-be7c7cd0e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:18.808787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d94410-393c-4650-81d4-be7c7cd0e28f admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:18.809532 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d94410-393c-4650-81d4-be7c7cd0e28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:18.819454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d94410-393c-4650-81d4-be7c7cd0e28f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:18.857887 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefa466-655f-4a3c-97ab-bd158ca3d732 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:18.869331 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1102/2217] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:18 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:18.873500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefa466-655f-4a3c-97ab-bd158ca3d732 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:18.893219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14138ab4-48eb-400b-9523-ca4f91f44232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:18.894239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138ab4-48eb-400b-9523-ca4f91f44232 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:18.894630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138ab4-48eb-400b-9523-ca4f91f44232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:18.894985 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138ab4-48eb-400b-9523-ca4f91f44232 admin admin] PATH_INFO: `/v3/projects/4c568974164940cc8e40d18a9c7ba1bb/users/e96b0e3275a24ff18c1a93f3cd61d554/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:18.922243 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14138ab4-48eb-400b-9523-ca4f91f44232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c568974164940cc8e40d18a9c7ba1bb, user_id=e96b0e3275a24ff18c1a93f3cd61d554, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:18.926075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14138ab4-48eb-400b-9523-ca4f91f44232 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:18.948045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1116/2218] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:18 2021] PUT /identity/v3/projects/4c568974164940cc8e40d18a9c7ba1bb/users/e96b0e3275a24ff18c1a93f3cd61d554/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:18.958896 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157c153-113b-4da7-8e73-011f5f7a1467 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:18.959187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157c153-113b-4da7-8e73-011f5f7a1467 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:18.959471 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157c153-113b-4da7-8e73-011f5f7a1467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:18.992116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-a157c153-113b-4da7-8e73-011f5f7a1467 None None] MFA Rules not processed for user `e96b0e3275a24ff18c1a93f3cd61d554`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:18.993664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a157c153-113b-4da7-8e73-011f5f7a1467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:19.100683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1103/2219] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:18 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:19.115861 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14138ab4-48eb-400b-9523-ca4f91f44232 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:19.118632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-14138ab4-48eb-400b-9523-ca4f91f44232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:19.194096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157c153-113b-4da7-8e73-011f5f7a1467 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:19.195598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a157c153-113b-4da7-8e73-011f5f7a1467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:19.298061 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14138ab4-48eb-400b-9523-ca4f91f44232 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:19.303078 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be993ce-83de-4742-b0c5-e7eb96ae3693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:19.304073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be993ce-83de-4742-b0c5-e7eb96ae3693 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:19.304561 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be993ce-83de-4742-b0c5-e7eb96ae3693 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:19.305086 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be993ce-83de-4742-b0c5-e7eb96ae3693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:19.309484 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157c153-113b-4da7-8e73-011f5f7a1467 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:19.315306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539408-db98-4596-b908-4368348ee73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:19.316176 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539408-db98-4596-b908-4368348ee73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:19.316459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539408-db98-4596-b908-4368348ee73c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:19.316886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539408-db98-4596-b908-4368348ee73c admin admin] PATH_INFO: `/v3/projects/cca696072005497db344b1a32f0c9874` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:19.318533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32539408-db98-4596-b908-4368348ee73c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca696072005497db344b1a32f0c9874)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:19.323149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32539408-db98-4596-b908-4368348ee73c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:19.324766 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be993ce-83de-4742-b0c5-e7eb96ae3693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:19.326748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be993ce-83de-4742-b0c5-e7eb96ae3693 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:19.338045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1117/2220] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:19 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:19.424882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-32539408-db98-4596-b908-4368348ee73c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca696072005497db344b1a32f0c9874', 'request_id': 'req-32539408-db98-4596-b908-4368348ee73c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:19.435038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-32539408-db98-4596-b908-4368348ee73c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca696072005497db344b1a32f0c9874', 'request_id': 'req-32539408-db98-4596-b908-4368348ee73c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:19.445753 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-32539408-db98-4596-b908-4368348ee73c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca696072005497db344b1a32f0c9874', 'request_id': 'req-32539408-db98-4596-b908-4368348ee73c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:19.489025 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-32539408-db98-4596-b908-4368348ee73c admin admin] The token cache is being invalidate because project cca696072005497db344b1a32f0c9874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:19.489796 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-32539408-db98-4596-b908-4368348ee73c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:19.490551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-32539408-db98-4596-b908-4368348ee73c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:19.492432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1104/2221] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:10:19 2021] DELETE /identity/v3/projects/cca696072005497db344b1a32f0c9874 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:19.499860 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2973c31-a20d-41e9-85e4-aa404a9de857 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:19.500712 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2973c31-a20d-41e9-85e4-aa404a9de857 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:19.501186 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2973c31-a20d-41e9-85e4-aa404a9de857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:19.531459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a2973c31-a20d-41e9-85e4-aa404a9de857 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:19.532908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a2973c31-a20d-41e9-85e4-aa404a9de857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:19.628033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1118/2222] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:19.637559 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf266862-e482-4d0f-ac83-f69942ccaf80 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:19.637935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf266862-e482-4d0f-ac83-f69942ccaf80 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:19.638289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf266862-e482-4d0f-ac83-f69942ccaf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:19.686683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-cf266862-e482-4d0f-ac83-f69942ccaf80 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:19.687943 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-cf266862-e482-4d0f-ac83-f69942ccaf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:19.730403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2973c31-a20d-41e9-85e4-aa404a9de857 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:19.737675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1105/2223] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:19.740119 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2973c31-a20d-41e9-85e4-aa404a9de857 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:19.756925 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711d9b9-21f9-4455-a74f-21c2a423f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:19.758293 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711d9b9-21f9-4455-a74f-21c2a423f92e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:19.758293 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711d9b9-21f9-4455-a74f-21c2a423f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:19.758293 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711d9b9-21f9-4455-a74f-21c2a423f92e admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:19.759585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711d9b9-21f9-4455-a74f-21c2a423f92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:10:19.759947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711d9b9-21f9-4455-a74f-21c2a423f92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:19.761518 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711d9b9-21f9-4455-a74f-21c2a423f92e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:19.779744 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf266862-e482-4d0f-ac83-f69942ccaf80 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:19.795931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf266862-e482-4d0f-ac83-f69942ccaf80 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:19.796604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1119/2224] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:10:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:10:19.803722 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e33491-95a0-4794-bf34-bb2b97c9f2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:19.804689 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e33491-95a0-4794-bf34-bb2b97c9f2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:19.805556 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e33491-95a0-4794-bf34-bb2b97c9f2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:19.806219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e33491-95a0-4794-bf34-bb2b97c9f2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:19.807402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e33491-95a0-4794-bf34-bb2b97c9f2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:19.809974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e33491-95a0-4794-bf34-bb2b97c9f2e6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:19.866124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711d9b9-21f9-4455-a74f-21c2a423f92e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:19.877511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1106/2225] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:19 2021] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:19.878770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711d9b9-21f9-4455-a74f-21c2a423f92e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:19.955743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318fe80-fc82-41e4-93cf-7e524cbbcb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:19.956782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318fe80-fc82-41e4-93cf-7e524cbbcb8d admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:19.957284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318fe80-fc82-41e4-93cf-7e524cbbcb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:19.957780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318fe80-fc82-41e4-93cf-7e524cbbcb8d admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:19.958762 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318fe80-fc82-41e4-93cf-7e524cbbcb8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:19.961279 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318fe80-fc82-41e4-93cf-7e524cbbcb8d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:20.001052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1120/2226] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:19 2021] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:10:20.004375 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e33491-95a0-4794-bf34-bb2b97c9f2e6 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:20.016717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e33491-95a0-4794-bf34-bb2b97c9f2e6 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:20.022838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7279be-9390-4866-b624-ded5927e2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:20.023987 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7279be-9390-4866-b624-ded5927e2cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:20.025272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7279be-9390-4866-b624-ded5927e2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:20.025727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7279be-9390-4866-b624-ded5927e2cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:20.026677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7279be-9390-4866-b624-ded5927e2cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:20.028488 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7279be-9390-4866-b624-ded5927e2cd0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:20.041651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1107/2227] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:20 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:20.045579 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318fe80-fc82-41e4-93cf-7e524cbbcb8d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:20.063573 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318fe80-fc82-41e4-93cf-7e524cbbcb8d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:20.071972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7279d9c-8926-49ba-935c-f46730538ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:20.072881 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7279d9c-8926-49ba-935c-f46730538ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:20.073049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7279d9c-8926-49ba-935c-f46730538ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:20.074913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7279d9c-8926-49ba-935c-f46730538ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:20.075867 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7279d9c-8926-49ba-935c-f46730538ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:20.077811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7279d9c-8926-49ba-935c-f46730538ff8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:20.093861 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1121/2228] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:20 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:10:20.097727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7279be-9390-4866-b624-ded5927e2cd0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:20.110286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7279be-9390-4866-b624-ded5927e2cd0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:20.118240 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726f8f-7d26-4624-a723-fde816b7e99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:20.119234 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726f8f-7d26-4624-a723-fde816b7e99d admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:20.119515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726f8f-7d26-4624-a723-fde816b7e99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:20.119791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726f8f-7d26-4624-a723-fde816b7e99d admin admin] PATH_INFO: `/v3/projects/16085d33b37748079101ff478a466116/users/fa430b1b11a14426aaaaca38e4e17e56/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:20.138052 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3726f8f-7d26-4624-a723-fde816b7e99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16085d33b37748079101ff478a466116, user_id=fa430b1b11a14426aaaaca38e4e17e56, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:20.141940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3726f8f-7d26-4624-a723-fde816b7e99d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:20.161458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1108/2229] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:20 2021] PUT /identity/v3/projects/16085d33b37748079101ff478a466116/users/fa430b1b11a14426aaaaca38e4e17e56/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:20.173346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455c09-cb99-4a73-941b-76fb1fa10d7e None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:20.173827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455c09-cb99-4a73-941b-76fb1fa10d7e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:20.174712 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455c09-cb99-4a73-941b-76fb1fa10d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:20.245216 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-dc455c09-cb99-4a73-941b-76fb1fa10d7e None None] MFA Rules not processed for user `fa430b1b11a14426aaaaca38e4e17e56`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:20.247011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-dc455c09-cb99-4a73-941b-76fb1fa10d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:20.350167 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1122/2230] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:20 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:20.364368 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726f8f-7d26-4624-a723-fde816b7e99d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:20.366111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f3726f8f-7d26-4624-a723-fde816b7e99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:20.459039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726f8f-7d26-4624-a723-fde816b7e99d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:20.463724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be449ac8-a338-4ce1-867e-6b780fa3be72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:20.464421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be449ac8-a338-4ce1-867e-6b780fa3be72 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:20.464421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be449ac8-a338-4ce1-867e-6b780fa3be72 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:20.464613 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be449ac8-a338-4ce1-867e-6b780fa3be72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:20.474044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be449ac8-a338-4ce1-867e-6b780fa3be72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:20.475501 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be449ac8-a338-4ce1-867e-6b780fa3be72 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:20.490923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1109/2231] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:20 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:23.387256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3e8e8-d662-471c-bc4a-151b0d58a55a None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:23.387817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3e8e8-d662-471c-bc4a-151b0d58a55a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:23.387817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3e8e8-d662-471c-bc4a-151b0d58a55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:23.405883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-bfa3e8e8-d662-471c-bc4a-151b0d58a55a None None] MFA Rules not processed for user `fc6ef8627a3a40638168ed0d45c19d95`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:23.407099 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-bfa3e8e8-d662-471c-bc4a-151b0d58a55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:23.466996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1123/2232] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:23 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:10:26.653073 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be449ac8-a338-4ce1-867e-6b780fa3be72 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:26.654801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-be449ac8-a338-4ce1-867e-6b780fa3be72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:26.728330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be449ac8-a338-4ce1-867e-6b780fa3be72 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:26.732761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:26.733605 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:26.733884 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:26.734154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] PATH_INFO: `/v3/users/752b7eb5866748c4b94210fcd9b3a904` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:26.735360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=752b7eb5866748c4b94210fcd9b3a904)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:26.737290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:26.781508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '752b7eb5866748c4b94210fcd9b3a904'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:26.788001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '752b7eb5866748c4b94210fcd9b3a904'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:26.788697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '752b7eb5866748c4b94210fcd9b3a904'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:26.789297 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '752b7eb5866748c4b94210fcd9b3a904'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:26.800504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '752b7eb5866748c4b94210fcd9b3a904'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:26.813706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1110/2233] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:10:26 2021] DELETE /identity/v3/users/752b7eb5866748c4b94210fcd9b3a904 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:26.818268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171216e-955f-471e-855c-edec8f725823 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:26.818747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171216e-955f-471e-855c-edec8f725823 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:26.818861 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171216e-955f-471e-855c-edec8f725823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:26.837660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a171216e-955f-471e-855c-edec8f725823 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:26.838810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a171216e-955f-471e-855c-edec8f725823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:26.895683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1124/2234] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:26.906000 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:26.907431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:26.962132 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349425e-0dbc-4067-9a2e-c2aca0d52d3b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:26.965792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e68eaa-cb4d-47c0-a95a-9531e4971670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:26.966456 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e68eaa-cb4d-47c0-a95a-9531e4971670 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:26.966743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e68eaa-cb4d-47c0-a95a-9531e4971670 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:26.967020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e68eaa-cb4d-47c0-a95a-9531e4971670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:26.976160 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e68eaa-cb4d-47c0-a95a-9531e4971670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:26.978128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e68eaa-cb4d-47c0-a95a-9531e4971670 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:26.987622 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1111/2235] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:27.248562 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171216e-955f-471e-855c-edec8f725823 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:27.250010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a171216e-955f-471e-855c-edec8f725823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:27.263552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171216e-955f-471e-855c-edec8f725823 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:27.269907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75302a41-09ca-4030-b242-2df2f3b68b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:27.270926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75302a41-09ca-4030-b242-2df2f3b68b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:27.271224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75302a41-09ca-4030-b242-2df2f3b68b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:27.271478 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75302a41-09ca-4030-b242-2df2f3b68b85 admin admin] PATH_INFO: `/v3/projects/dd1f22094bc94a269f27968fba9adcd4` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:27.272723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75302a41-09ca-4030-b242-2df2f3b68b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1f22094bc94a269f27968fba9adcd4)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:27.274857 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75302a41-09ca-4030-b242-2df2f3b68b85 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:27.322609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-75302a41-09ca-4030-b242-2df2f3b68b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1f22094bc94a269f27968fba9adcd4', 'request_id': 'req-75302a41-09ca-4030-b242-2df2f3b68b85'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:27.328556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-75302a41-09ca-4030-b242-2df2f3b68b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1f22094bc94a269f27968fba9adcd4', 'request_id': 'req-75302a41-09ca-4030-b242-2df2f3b68b85'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:27.336248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-75302a41-09ca-4030-b242-2df2f3b68b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1f22094bc94a269f27968fba9adcd4', 'request_id': 'req-75302a41-09ca-4030-b242-2df2f3b68b85'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:27.346646 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-75302a41-09ca-4030-b242-2df2f3b68b85 admin admin] The token cache is being invalidate because project dd1f22094bc94a269f27968fba9adcd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:27.346983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-75302a41-09ca-4030-b242-2df2f3b68b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:27.347551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-75302a41-09ca-4030-b242-2df2f3b68b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:27.349094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1125/2236] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:10:27 2021] DELETE /identity/v3/projects/dd1f22094bc94a269f27968fba9adcd4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:27.355206 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c18696-b936-4ebf-80b6-ac7e98a349cb None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:27.355496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c18696-b936-4ebf-80b6-ac7e98a349cb None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:27.355774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c18696-b936-4ebf-80b6-ac7e98a349cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:27.374080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d6c18696-b936-4ebf-80b6-ac7e98a349cb None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:27.375299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d6c18696-b936-4ebf-80b6-ac7e98a349cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:27.431389 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1112/2237] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:27.439250 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc165c0f-0f35-4481-b416-5c1672c97bcc None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:27.439389 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc165c0f-0f35-4481-b416-5c1672c97bcc None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:27.439668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc165c0f-0f35-4481-b416-5c1672c97bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:27.458536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-cc165c0f-0f35-4481-b416-5c1672c97bcc None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:27.459752 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cc165c0f-0f35-4481-b416-5c1672c97bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:27.467783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1126/2238] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:27.472259 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c18696-b936-4ebf-80b6-ac7e98a349cb None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:27.481935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c18696-b936-4ebf-80b6-ac7e98a349cb None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:27.486556 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab06ce-2c89-4d56-abfb-34788af8e840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:27.487209 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab06ce-2c89-4d56-abfb-34788af8e840 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:27.487492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab06ce-2c89-4d56-abfb-34788af8e840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:27.487771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab06ce-2c89-4d56-abfb-34788af8e840 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:27.488506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab06ce-2c89-4d56-abfb-34788af8e840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:10:27.488818 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab06ce-2c89-4d56-abfb-34788af8e840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:27.490450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab06ce-2c89-4d56-abfb-34788af8e840 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:27.503606 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1113/2239] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:10:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:10:27.508312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc165c0f-0f35-4481-b416-5c1672c97bcc None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:27.518052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc165c0f-0f35-4481-b416-5c1672c97bcc None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:27.522720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76026836-c20c-431b-a1db-1ad6be15eb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:27.523363 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76026836-c20c-431b-a1db-1ad6be15eb5e admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:27.523642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76026836-c20c-431b-a1db-1ad6be15eb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:27.523958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76026836-c20c-431b-a1db-1ad6be15eb5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:27.524665 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76026836-c20c-431b-a1db-1ad6be15eb5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:27.526695 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76026836-c20c-431b-a1db-1ad6be15eb5e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:27.551812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1127/2240] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:27 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:27.557082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab06ce-2c89-4d56-abfb-34788af8e840 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:27.566838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab06ce-2c89-4d56-abfb-34788af8e840 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:27.622514 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5e697-3116-47b2-8f71-234b17d9e4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:27.623091 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5e697-3116-47b2-8f71-234b17d9e4cd admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:27.623374 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5e697-3116-47b2-8f71-234b17d9e4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:27.623651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5e697-3116-47b2-8f71-234b17d9e4cd admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:27.624348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5e697-3116-47b2-8f71-234b17d9e4cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:27.626242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5e697-3116-47b2-8f71-234b17d9e4cd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:27.646297 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1114/2241] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:27 2021] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:27.650749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76026836-c20c-431b-a1db-1ad6be15eb5e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:27.660817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76026836-c20c-431b-a1db-1ad6be15eb5e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:27.665890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b2990-b022-4881-8359-a17fad1b6418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:27.666633 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b2990-b022-4881-8359-a17fad1b6418 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:27.666873 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b2990-b022-4881-8359-a17fad1b6418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:27.667147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b2990-b022-4881-8359-a17fad1b6418 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:27.667896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b2990-b022-4881-8359-a17fad1b6418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:27.669491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b2990-b022-4881-8359-a17fad1b6418 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:27.683050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1128/2242] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:27 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:27.686913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5e697-3116-47b2-8f71-234b17d9e4cd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:27.698557 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5e697-3116-47b2-8f71-234b17d9e4cd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:27.703220 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b22425-d2bb-4227-8a98-76f163b0908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:27.703869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b22425-d2bb-4227-8a98-76f163b0908f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:27.704202 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b22425-d2bb-4227-8a98-76f163b0908f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:27.704482 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b22425-d2bb-4227-8a98-76f163b0908f admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:27.705263 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b22425-d2bb-4227-8a98-76f163b0908f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:27.706918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b22425-d2bb-4227-8a98-76f163b0908f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:27.721228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1115/2243] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:27 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:27.722435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b2990-b022-4881-8359-a17fad1b6418 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:27.732774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b2990-b022-4881-8359-a17fad1b6418 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:27.737699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eb77a-7ebd-4c5e-8409-3091e7b3993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:27.738680 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eb77a-7ebd-4c5e-8409-3091e7b3993a admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:27.738962 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eb77a-7ebd-4c5e-8409-3091e7b3993a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:27.739238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eb77a-7ebd-4c5e-8409-3091e7b3993a admin admin] PATH_INFO: `/v3/projects/a965b3ef21e14d8787cc1b57b914f806/users/d0b8bb5afcbc4159b3f6256d8fe93997/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:27.754228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696eb77a-7ebd-4c5e-8409-3091e7b3993a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a965b3ef21e14d8787cc1b57b914f806, user_id=d0b8bb5afcbc4159b3f6256d8fe93997, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:27.756891 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696eb77a-7ebd-4c5e-8409-3091e7b3993a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:27.769740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1129/2244] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:27 2021] PUT /identity/v3/projects/a965b3ef21e14d8787cc1b57b914f806/users/d0b8bb5afcbc4159b3f6256d8fe93997/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:27.775209 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c9972-6bed-4fe1-8c3b-c54fc04720f5 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:27.775760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c9972-6bed-4fe1-8c3b-c54fc04720f5 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:27.776043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c9972-6bed-4fe1-8c3b-c54fc04720f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:27.794759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-8f2c9972-6bed-4fe1-8c3b-c54fc04720f5 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:27.795967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8f2c9972-6bed-4fe1-8c3b-c54fc04720f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:27.860782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1116/2245] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:27.871734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eb77a-7ebd-4c5e-8409-3091e7b3993a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:27.873546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-696eb77a-7ebd-4c5e-8409-3091e7b3993a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:27.931045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eb77a-7ebd-4c5e-8409-3091e7b3993a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:27.934638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f9a04-a120-466c-88fa-c0d0d4fc1e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:27.935272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f9a04-a120-466c-88fa-c0d0d4fc1e41 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:27.935550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f9a04-a120-466c-88fa-c0d0d4fc1e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:27.935823 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f9a04-a120-466c-88fa-c0d0d4fc1e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:27.944564 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f9a04-a120-466c-88fa-c0d0d4fc1e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:27.946017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f9a04-a120-466c-88fa-c0d0d4fc1e41 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:27.955159 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1130/2246] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:28.545853 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d119-a7e8-47a4-ba1f-1c48ea890e33 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:28.546751 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d119-a7e8-47a4-ba1f-1c48ea890e33 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:28.547209 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d119-a7e8-47a4-ba1f-1c48ea890e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:28.573518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-0fe5d119-a7e8-47a4-ba1f-1c48ea890e33 None None] MFA Rules not processed for user `d0b8bb5afcbc4159b3f6256d8fe93997`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:28.574760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0fe5d119-a7e8-47a4-ba1f-1c48ea890e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:28.639228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1117/2247] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:28 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:10:28.649760 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f9a04-a120-466c-88fa-c0d0d4fc1e41 service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:28.651186 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-510f9a04-a120-466c-88fa-c0d0d4fc1e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:28.706303 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f9a04-a120-466c-88fa-c0d0d4fc1e41 service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:28.709722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca9577-d0f9-4e75-b7c6-7d21ed1e8616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:28.710356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca9577-d0f9-4e75-b7c6-7d21ed1e8616 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:28.710657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca9577-d0f9-4e75-b7c6-7d21ed1e8616 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:28.710929 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca9577-d0f9-4e75-b7c6-7d21ed1e8616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:28.719826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca9577-d0f9-4e75-b7c6-7d21ed1e8616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:28.721238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca9577-d0f9-4e75-b7c6-7d21ed1e8616 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:28.730718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1131/2248] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:28 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:29.072033 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cec8e9-c947-456b-9326-4391190dc8c1 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:29.072603 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cec8e9-c947-456b-9326-4391190dc8c1 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:29.072603 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cec8e9-c947-456b-9326-4391190dc8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:29.091832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-06cec8e9-c947-456b-9326-4391190dc8c1 None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:29.093049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-06cec8e9-c947-456b-9326-4391190dc8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:29.159862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1118/2249] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:10:29 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:10:29.179479 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca9577-d0f9-4e75-b7c6-7d21ed1e8616 service cinder] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:29.182071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a1ca9577-d0f9-4e75-b7c6-7d21ed1e8616 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:29.266511 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca9577-d0f9-4e75-b7c6-7d21ed1e8616 service cinder] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:29.272038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330c519-2da7-4b61-94c0-7e6e90a3baf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:29.272789 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330c519-2da7-4b61-94c0-7e6e90a3baf6 service swift] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:29.273143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330c519-2da7-4b61-94c0-7e6e90a3baf6 service swift] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:29.274074 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330c519-2da7-4b61-94c0-7e6e90a3baf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:29.284317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330c519-2da7-4b61-94c0-7e6e90a3baf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:29.286098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330c519-2da7-4b61-94c0-7e6e90a3baf6 service swift] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:29.295898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1132/2250] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:10:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 01:10:37.445715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3328618-50f4-4205-a678-afdd7e282ac4 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:37.446337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3328618-50f4-4205-a678-afdd7e282ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:37.446909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3328618-50f4-4205-a678-afdd7e282ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:37.464152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c3328618-50f4-4205-a678-afdd7e282ac4 None None] MFA Rules not processed for user `d0b8bb5afcbc4159b3f6256d8fe93997`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:37.465522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c3328618-50f4-4205-a678-afdd7e282ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:37.473824 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1119/2251] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:37 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:42.630104 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b83613-9e40-45b4-94a4-58de44d6c5ec None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:42.632132 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b83613-9e40-45b4-94a4-58de44d6c5ec None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:42.634690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b83613-9e40-45b4-94a4-58de44d6c5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:42.654324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a2b83613-9e40-45b4-94a4-58de44d6c5ec None None] MFA Rules not processed for user `59d2b98f1809405ab307a035062400c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:42.655453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a2b83613-9e40-45b4-94a4-58de44d6c5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:42.721915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1133/2252] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:42 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:44.004844 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3328618-50f4-4205-a678-afdd7e282ac4 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:44.006547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c3328618-50f4-4205-a678-afdd7e282ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:44.036060 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3328618-50f4-4205-a678-afdd7e282ac4 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:44.048960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:44.050929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:44.051291 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:44.051648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] PATH_INFO: `/v3/users/fa430b1b11a14426aaaaca38e4e17e56` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:44.055365 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa430b1b11a14426aaaaca38e4e17e56)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:44.060280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:44.146726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa430b1b11a14426aaaaca38e4e17e56'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:44.156986 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa430b1b11a14426aaaaca38e4e17e56'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:44.157930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa430b1b11a14426aaaaca38e4e17e56'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:44.158615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa430b1b11a14426aaaaca38e4e17e56'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:44.174566 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa430b1b11a14426aaaaca38e4e17e56'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:44.199446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1120/2253] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:10:44 2021] DELETE /identity/v3/users/fa430b1b11a14426aaaaca38e4e17e56 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:44.207131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddb8e1-743c-428f-bd9d-a5f490170070 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:44.207692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddb8e1-743c-428f-bd9d-a5f490170070 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:44.211566 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddb8e1-743c-428f-bd9d-a5f490170070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:44.249166 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-43ddb8e1-743c-428f-bd9d-a5f490170070 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:44.261265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-43ddb8e1-743c-428f-bd9d-a5f490170070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:44.357153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1134/2254] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:44.418567 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:44.420304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:44.557673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3fe6-42e4-471c-97a3-eb0a61ada530 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:44.569454 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868d144-c1ea-4b24-9418-d362269fc554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:44.570565 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868d144-c1ea-4b24-9418-d362269fc554 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:44.571517 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868d144-c1ea-4b24-9418-d362269fc554 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:44.571942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868d144-c1ea-4b24-9418-d362269fc554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:44.596566 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868d144-c1ea-4b24-9418-d362269fc554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:44.598053 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868d144-c1ea-4b24-9418-d362269fc554 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:44.623741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1121/2255] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:45.087465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddb8e1-743c-428f-bd9d-a5f490170070 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:45.089407 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-43ddb8e1-743c-428f-bd9d-a5f490170070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:45.105984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddb8e1-743c-428f-bd9d-a5f490170070 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:45.135284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f5a83-33ed-481b-b504-0811970c1fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:45.136342 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f5a83-33ed-481b-b504-0811970c1fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:45.136627 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f5a83-33ed-481b-b504-0811970c1fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:45.136916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f5a83-33ed-481b-b504-0811970c1fb2 admin admin] PATH_INFO: `/v3/projects/16085d33b37748079101ff478a466116` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:45.140495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f5a83-33ed-481b-b504-0811970c1fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16085d33b37748079101ff478a466116)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:45.149433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f5a83-33ed-481b-b504-0811970c1fb2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:45.225294 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-f73f5a83-33ed-481b-b504-0811970c1fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16085d33b37748079101ff478a466116', 'request_id': 'req-f73f5a83-33ed-481b-b504-0811970c1fb2'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:45.232796 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-f73f5a83-33ed-481b-b504-0811970c1fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16085d33b37748079101ff478a466116', 'request_id': 'req-f73f5a83-33ed-481b-b504-0811970c1fb2'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:45.241322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-f73f5a83-33ed-481b-b504-0811970c1fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16085d33b37748079101ff478a466116', 'request_id': 'req-f73f5a83-33ed-481b-b504-0811970c1fb2'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:45.254586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-f73f5a83-33ed-481b-b504-0811970c1fb2 admin admin] The token cache is being invalidate because project 16085d33b37748079101ff478a466116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:45.254877 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-f73f5a83-33ed-481b-b504-0811970c1fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:45.255543 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-f73f5a83-33ed-481b-b504-0811970c1fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:45.257133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1135/2256] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:10:45 2021] DELETE /identity/v3/projects/16085d33b37748079101ff478a466116 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:45.269598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1d38f-7dc7-4250-b80d-ffb016b19f1c None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:45.270795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1d38f-7dc7-4250-b80d-ffb016b19f1c None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:45.271137 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1d38f-7dc7-4250-b80d-ffb016b19f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:45.304353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-01c1d38f-7dc7-4250-b80d-ffb016b19f1c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:45.306148 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-01c1d38f-7dc7-4250-b80d-ffb016b19f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:45.383304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1122/2257] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:45.391666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d5ce3-7a95-4d21-8817-22128ea1fc45 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:45.392010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d5ce3-7a95-4d21-8817-22128ea1fc45 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:45.392265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d5ce3-7a95-4d21-8817-22128ea1fc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:45.437316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-fc0d5ce3-7a95-4d21-8817-22128ea1fc45 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:45.438964 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fc0d5ce3-7a95-4d21-8817-22128ea1fc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:45.450121 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1136/2258] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:45.454536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1d38f-7dc7-4250-b80d-ffb016b19f1c None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:45.465836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1d38f-7dc7-4250-b80d-ffb016b19f1c None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:45.471686 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4acc3-0c69-4a06-b489-692a488f52f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:45.472600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4acc3-0c69-4a06-b489-692a488f52f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:45.472974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4acc3-0c69-4a06-b489-692a488f52f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:45.473467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4acc3-0c69-4a06-b489-692a488f52f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:45.474348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4acc3-0c69-4a06-b489-692a488f52f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:10:45.474830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4acc3-0c69-4a06-b489-692a488f52f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:45.476608 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4acc3-0c69-4a06-b489-692a488f52f8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:45.489710 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1123/2259] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:10:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:10:45.495587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d5ce3-7a95-4d21-8817-22128ea1fc45 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:45.507070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d5ce3-7a95-4d21-8817-22128ea1fc45 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:45.531132 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11519b5a-b700-4053-8da4-12a0f78f5264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:45.531969 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11519b5a-b700-4053-8da4-12a0f78f5264 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:45.532316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11519b5a-b700-4053-8da4-12a0f78f5264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:45.532657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11519b5a-b700-4053-8da4-12a0f78f5264 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:45.533498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11519b5a-b700-4053-8da4-12a0f78f5264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:45.536613 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11519b5a-b700-4053-8da4-12a0f78f5264 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:45.575995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1137/2260] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:45 2021] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:45.580071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4acc3-0c69-4a06-b489-692a488f52f8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:45.592835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4acc3-0c69-4a06-b489-692a488f52f8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:45.674748 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac0000-8833-44c3-8824-0b5df5095317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:45.675907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac0000-8833-44c3-8824-0b5df5095317 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:45.676266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac0000-8833-44c3-8824-0b5df5095317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:45.676616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac0000-8833-44c3-8824-0b5df5095317 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:45.677426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac0000-8833-44c3-8824-0b5df5095317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:45.680842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac0000-8833-44c3-8824-0b5df5095317 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:45.716862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1124/2261] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:45 2021] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:45.722033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11519b5a-b700-4053-8da4-12a0f78f5264 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:45.735442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11519b5a-b700-4053-8da4-12a0f78f5264 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:45.743045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91950a6-6390-4dc9-a301-d113ca05087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:45.744951 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91950a6-6390-4dc9-a301-d113ca05087f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:45.746308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91950a6-6390-4dc9-a301-d113ca05087f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:45.746757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91950a6-6390-4dc9-a301-d113ca05087f admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:45.747724 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91950a6-6390-4dc9-a301-d113ca05087f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:45.750348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91950a6-6390-4dc9-a301-d113ca05087f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:45.768622 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1138/2262] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:45 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:10:45.773002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac0000-8833-44c3-8824-0b5df5095317 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:45.787947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac0000-8833-44c3-8824-0b5df5095317 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:45.794545 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3dda4-d58b-42a1-bc02-ec97c2b66a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:45.795288 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3dda4-d58b-42a1-bc02-ec97c2b66a13 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:45.795780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3dda4-d58b-42a1-bc02-ec97c2b66a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:45.796448 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3dda4-d58b-42a1-bc02-ec97c2b66a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:45.797399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3dda4-d58b-42a1-bc02-ec97c2b66a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:45.799168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3dda4-d58b-42a1-bc02-ec97c2b66a13 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:45.812507 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1125/2263] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:45 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:45.816739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91950a6-6390-4dc9-a301-d113ca05087f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:45.830450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91950a6-6390-4dc9-a301-d113ca05087f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:45.835946 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cf3ba-dcdd-4ddf-bfcf-434daa5d7d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:45.837711 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cf3ba-dcdd-4ddf-bfcf-434daa5d7d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:45.838216 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cf3ba-dcdd-4ddf-bfcf-434daa5d7d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:45.838554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cf3ba-dcdd-4ddf-bfcf-434daa5d7d21 admin admin] PATH_INFO: `/v3/projects/34ac7d7abcb742b9b57d9597941c49b8/users/2eb55200db284e73af346d20eb11fbc5/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:45.859119 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cf3ba-dcdd-4ddf-bfcf-434daa5d7d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ac7d7abcb742b9b57d9597941c49b8, user_id=2eb55200db284e73af346d20eb11fbc5, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:45.861814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cf3ba-dcdd-4ddf-bfcf-434daa5d7d21 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:45.878191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1139/2264] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:45 2021] PUT /identity/v3/projects/34ac7d7abcb742b9b57d9597941c49b8/users/2eb55200db284e73af346d20eb11fbc5/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:45.889098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2719b37-6555-41c0-89d7-c4c1463173f7 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:45.889611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2719b37-6555-41c0-89d7-c4c1463173f7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:45.889899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2719b37-6555-41c0-89d7-c4c1463173f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:45.922406 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-a2719b37-6555-41c0-89d7-c4c1463173f7 None None] MFA Rules not processed for user `2eb55200db284e73af346d20eb11fbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:45.923821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a2719b37-6555-41c0-89d7-c4c1463173f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:46.010248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1126/2265] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:45 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:10:46.021183 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cf3ba-dcdd-4ddf-bfcf-434daa5d7d21 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:46.023470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-3e9cf3ba-dcdd-4ddf-bfcf-434daa5d7d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:46.082874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cf3ba-dcdd-4ddf-bfcf-434daa5d7d21 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:46.087810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0b885-c361-4ca8-95cf-b6728a5dc585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:46.088456 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0b885-c361-4ca8-95cf-b6728a5dc585 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:46.088735 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0b885-c361-4ca8-95cf-b6728a5dc585 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:46.089005 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0b885-c361-4ca8-95cf-b6728a5dc585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:46.099441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0b885-c361-4ca8-95cf-b6728a5dc585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:46.099791 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0b885-c361-4ca8-95cf-b6728a5dc585 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:46.109662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1140/2266] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:46 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:51.154926 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2719b37-6555-41c0-89d7-c4c1463173f7 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:51.272224 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2719b37-6555-41c0-89d7-c4c1463173f7 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:51.277629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:51.278626 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:51.279118 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:51.279581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] PATH_INFO: `/v3/users/2eb55200db284e73af346d20eb11fbc5` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:51.282608 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb55200db284e73af346d20eb11fbc5)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:51.285447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:51.362572 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb55200db284e73af346d20eb11fbc5'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:51.386206 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb55200db284e73af346d20eb11fbc5'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:51.399830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb55200db284e73af346d20eb11fbc5'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:51.400849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb55200db284e73af346d20eb11fbc5'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:51.416579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb55200db284e73af346d20eb11fbc5'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:51.436543 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1127/2267] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:10:51 2021] DELETE /identity/v3/users/2eb55200db284e73af346d20eb11fbc5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:51.441607 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd918be3-011a-4569-9fa4-b8eaf7dc8c6b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:51.442060 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd918be3-011a-4569-9fa4-b8eaf7dc8c6b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:51.442174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd918be3-011a-4569-9fa4-b8eaf7dc8c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:51.466444 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-cd918be3-011a-4569-9fa4-b8eaf7dc8c6b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:51.467368 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cd918be3-011a-4569-9fa4-b8eaf7dc8c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:51.541841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1141/2268] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:10:51.551810 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:51.553227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:51.577824 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd918be3-011a-4569-9fa4-b8eaf7dc8c6b None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:51.579246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cd918be3-011a-4569-9fa4-b8eaf7dc8c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:51.591658 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd918be3-011a-4569-9fa4-b8eaf7dc8c6b None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:51.596875 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:51.597770 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:51.598047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:51.598317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] PATH_INFO: `/v3/users/2af8ce4ede4048e49401c08fd0861a0d` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:51.599570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af8ce4ede4048e49401c08fd0861a0d)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:51.602510 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:51.624230 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f828a2-78f9-4f47-9517-bb7ef9b7ca77 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:51.627954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92cde3-b6d7-4808-b462-cb88f240df30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:51.628811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92cde3-b6d7-4808-b462-cb88f240df30 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:51.629144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92cde3-b6d7-4808-b462-cb88f240df30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:51.629508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92cde3-b6d7-4808-b462-cb88f240df30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:51.642069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92cde3-b6d7-4808-b462-cb88f240df30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:51.644234 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92cde3-b6d7-4808-b462-cb88f240df30 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:51.656538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1128/2269] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:51.672846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af8ce4ede4048e49401c08fd0861a0d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:51.673601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af8ce4ede4048e49401c08fd0861a0d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:51.684676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af8ce4ede4048e49401c08fd0861a0d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:51.686081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af8ce4ede4048e49401c08fd0861a0d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:51.703450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af8ce4ede4048e49401c08fd0861a0d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:51.720685 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1142/2270] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:10:51 2021] DELETE /identity/v3/users/2af8ce4ede4048e49401c08fd0861a0d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:51.725362 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac9c1c-705e-4f9d-bd50-01f511b5503b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:51.725636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac9c1c-705e-4f9d-bd50-01f511b5503b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:51.726054 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac9c1c-705e-4f9d-bd50-01f511b5503b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:51.749049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-ccac9c1c-705e-4f9d-bd50-01f511b5503b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:51.750428 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ccac9c1c-705e-4f9d-bd50-01f511b5503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:51.837057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1129/2271] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:51.868388 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:51.870214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:51.960070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaaa59-8a9c-4f79-9780-2af5fe3a6fb2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:51.964200 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df62c27-07f3-46c1-9320-ac9a02efaa36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:51.964981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62c27-07f3-46c1-9320-ac9a02efaa36 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:51.965368 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62c27-07f3-46c1-9320-ac9a02efaa36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:51.965843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62c27-07f3-46c1-9320-ac9a02efaa36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:51.985167 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df62c27-07f3-46c1-9320-ac9a02efaa36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:51.986883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df62c27-07f3-46c1-9320-ac9a02efaa36 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:51.999121 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1143/2272] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:52.084352 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac9c1c-705e-4f9d-bd50-01f511b5503b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:52.091942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ccac9c1c-705e-4f9d-bd50-01f511b5503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:52.114167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac9c1c-705e-4f9d-bd50-01f511b5503b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:52.121666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0367f25-e673-4f1f-b1dc-58792b257bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:52.122619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0367f25-e673-4f1f-b1dc-58792b257bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:52.122953 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0367f25-e673-4f1f-b1dc-58792b257bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:52.123276 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0367f25-e673-4f1f-b1dc-58792b257bc2 admin admin] PATH_INFO: `/v3/projects/34ac7d7abcb742b9b57d9597941c49b8` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:52.125161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0367f25-e673-4f1f-b1dc-58792b257bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ac7d7abcb742b9b57d9597941c49b8)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:52.127725 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0367f25-e673-4f1f-b1dc-58792b257bc2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:52.207020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d0367f25-e673-4f1f-b1dc-58792b257bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ac7d7abcb742b9b57d9597941c49b8', 'request_id': 'req-d0367f25-e673-4f1f-b1dc-58792b257bc2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:52.213735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d0367f25-e673-4f1f-b1dc-58792b257bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ac7d7abcb742b9b57d9597941c49b8', 'request_id': 'req-d0367f25-e673-4f1f-b1dc-58792b257bc2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:52.220889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d0367f25-e673-4f1f-b1dc-58792b257bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ac7d7abcb742b9b57d9597941c49b8', 'request_id': 'req-d0367f25-e673-4f1f-b1dc-58792b257bc2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:52.258581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d0367f25-e673-4f1f-b1dc-58792b257bc2 admin admin] The token cache is being invalidate because project 34ac7d7abcb742b9b57d9597941c49b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:52.258984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d0367f25-e673-4f1f-b1dc-58792b257bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:52.259716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d0367f25-e673-4f1f-b1dc-58792b257bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:52.262921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1130/2273] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:10:52 2021] DELETE /identity/v3/projects/34ac7d7abcb742b9b57d9597941c49b8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:52.268427 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a5dd-e8e7-4458-94aa-e25ddf74d877 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:52.268868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a5dd-e8e7-4458-94aa-e25ddf74d877 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:52.269102 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a5dd-e8e7-4458-94aa-e25ddf74d877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:52.305593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-6ef6a5dd-e8e7-4458-94aa-e25ddf74d877 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:52.306853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6ef6a5dd-e8e7-4458-94aa-e25ddf74d877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:52.403428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1144/2274] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:52.405356 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccefe91-345d-495f-b126-f91c060dc7af None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:52.405712 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccefe91-345d-495f-b126-f91c060dc7af None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:52.406061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccefe91-345d-495f-b126-f91c060dc7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:52.428188 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-6ccefe91-345d-495f-b126-f91c060dc7af None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:52.430174 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-6ccefe91-345d-495f-b126-f91c060dc7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:52.453924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1131/2275] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:10:52.458500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6a5dd-e8e7-4458-94aa-e25ddf74d877 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:52.490027 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6a5dd-e8e7-4458-94aa-e25ddf74d877 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:52.497170 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb234f31-bd89-4bec-a07d-af8c9d88fb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:52.498103 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb234f31-bd89-4bec-a07d-af8c9d88fb3b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:52.498565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb234f31-bd89-4bec-a07d-af8c9d88fb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:52.498983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb234f31-bd89-4bec-a07d-af8c9d88fb3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:52.500636 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb234f31-bd89-4bec-a07d-af8c9d88fb3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:10:52.501110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb234f31-bd89-4bec-a07d-af8c9d88fb3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:52.502912 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb234f31-bd89-4bec-a07d-af8c9d88fb3b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:52.521201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1145/2276] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:10:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:10:52.527147 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccefe91-345d-495f-b126-f91c060dc7af None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:52.551988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccefe91-345d-495f-b126-f91c060dc7af None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:52.569050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb234f31-bd89-4bec-a07d-af8c9d88fb3b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:52.571044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ca744-3323-4285-965e-d03d1cabe7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:52.572693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cb234f31-bd89-4bec-a07d-af8c9d88fb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:52.575438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ca744-3323-4285-965e-d03d1cabe7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:52.576455 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ca744-3323-4285-965e-d03d1cabe7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:52.578470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ca744-3323-4285-965e-d03d1cabe7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:52.579720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ca744-3323-4285-965e-d03d1cabe7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:52.588376 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ca744-3323-4285-965e-d03d1cabe7a2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:52.609025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb234f31-bd89-4bec-a07d-af8c9d88fb3b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:52.624481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dea91-8fd7-4e4a-8684-b93e47788c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:52.625536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dea91-8fd7-4e4a-8684-b93e47788c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:52.626150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dea91-8fd7-4e4a-8684-b93e47788c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:52.626630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dea91-8fd7-4e4a-8684-b93e47788c89 admin admin] PATH_INFO: `/v3/projects/06c4ec42f14543b5ae58ba3b1da24dde` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:52.628118 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568dea91-8fd7-4e4a-8684-b93e47788c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c4ec42f14543b5ae58ba3b1da24dde)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:52.635039 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568dea91-8fd7-4e4a-8684-b93e47788c89 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:52.654390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1132/2277] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:52 2021] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:52.657147 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ca744-3323-4285-965e-d03d1cabe7a2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:52.756745 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-568dea91-8fd7-4e4a-8684-b93e47788c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c4ec42f14543b5ae58ba3b1da24dde', 'request_id': 'req-568dea91-8fd7-4e4a-8684-b93e47788c89'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:52.780112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-568dea91-8fd7-4e4a-8684-b93e47788c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c4ec42f14543b5ae58ba3b1da24dde', 'request_id': 'req-568dea91-8fd7-4e4a-8684-b93e47788c89'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:52.796287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-568dea91-8fd7-4e4a-8684-b93e47788c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c4ec42f14543b5ae58ba3b1da24dde', 'request_id': 'req-568dea91-8fd7-4e4a-8684-b93e47788c89'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:52.812462 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ca744-3323-4285-965e-d03d1cabe7a2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:52.816091 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-568dea91-8fd7-4e4a-8684-b93e47788c89 admin admin] The token cache is being invalidate because project 06c4ec42f14543b5ae58ba3b1da24dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:52.816381 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-568dea91-8fd7-4e4a-8684-b93e47788c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:52.817044 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-568dea91-8fd7-4e4a-8684-b93e47788c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:52.818745 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1146/2278] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:10:52 2021] DELETE /identity/v3/projects/06c4ec42f14543b5ae58ba3b1da24dde => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:52.825993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283a1de-7b92-4e9e-af11-8f6527901bb3 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:52.826277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283a1de-7b92-4e9e-af11-8f6527901bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:52.826745 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283a1de-7b92-4e9e-af11-8f6527901bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:52.856792 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9283a1de-7b92-4e9e-af11-8f6527901bb3 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:52.858163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9283a1de-7b92-4e9e-af11-8f6527901bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:52.881531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dae91a-d8c6-4768-92b5-31c6a00482c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:52.882865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dae91a-d8c6-4768-92b5-31c6a00482c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:52.883165 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dae91a-d8c6-4768-92b5-31c6a00482c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:52.883449 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dae91a-d8c6-4768-92b5-31c6a00482c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:52.884154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dae91a-d8c6-4768-92b5-31c6a00482c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:52.886078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dae91a-d8c6-4768-92b5-31c6a00482c8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:52.906412 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1133/2279] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:52 2021] POST /identity/v3/users => generated 285 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:52.910444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dae91a-d8c6-4768-92b5-31c6a00482c8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:52.912039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-17dae91a-d8c6-4768-92b5-31c6a00482c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:52.918083 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1147/2280] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:52.925619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dae91a-d8c6-4768-92b5-31c6a00482c8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:52.926340 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5015f-9054-4663-a7bc-6428e5131e4b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:52.926722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5015f-9054-4663-a7bc-6428e5131e4b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:52.927007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5015f-9054-4663-a7bc-6428e5131e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:52.931450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33712499-cbc8-45e9-89d7-3594b5711cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:52.932158 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33712499-cbc8-45e9-89d7-3594b5711cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:52.932481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33712499-cbc8-45e9-89d7-3594b5711cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:52.932764 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33712499-cbc8-45e9-89d7-3594b5711cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:52.934198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33712499-cbc8-45e9-89d7-3594b5711cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:52.935256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33712499-cbc8-45e9-89d7-3594b5711cc0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:52.946203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1134/2281] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:52 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:10:52.950485 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33712499-cbc8-45e9-89d7-3594b5711cc0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:52.951306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-bbf5015f-9054-4663-a7bc-6428e5131e4b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:52.952534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-bbf5015f-9054-4663-a7bc-6428e5131e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:52.961225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1148/2282] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:10:52.962519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33712499-cbc8-45e9-89d7-3594b5711cc0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:52.965407 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5015f-9054-4663-a7bc-6428e5131e4b None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:52.967302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44060045-911a-40eb-b620-7e431edf15c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:52.967956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44060045-911a-40eb-b620-7e431edf15c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:52.968241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44060045-911a-40eb-b620-7e431edf15c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:52.968517 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44060045-911a-40eb-b620-7e431edf15c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:52.969515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44060045-911a-40eb-b620-7e431edf15c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:52.971139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44060045-911a-40eb-b620-7e431edf15c7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:52.977025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5015f-9054-4663-a7bc-6428e5131e4b None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:52.982413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1135/2283] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:52 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:10:52.985625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993186a3-3a17-4d95-9a81-ca31605ffbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:52.985898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44060045-911a-40eb-b620-7e431edf15c7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:52.986461 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993186a3-3a17-4d95-9a81-ca31605ffbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:52.986808 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993186a3-3a17-4d95-9a81-ca31605ffbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:52.987148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993186a3-3a17-4d95-9a81-ca31605ffbf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:52.987954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993186a3-3a17-4d95-9a81-ca31605ffbf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:10:52.988325 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993186a3-3a17-4d95-9a81-ca31605ffbf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:52.989978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993186a3-3a17-4d95-9a81-ca31605ffbf5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:52.996194 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44060045-911a-40eb-b620-7e431edf15c7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:53.001695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71ddee-ef8f-4e11-bf1c-7c6c0ea5db1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:53.006212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1149/2284] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:10:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:10:53.006378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71ddee-ef8f-4e11-bf1c-7c6c0ea5db1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:53.006378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71ddee-ef8f-4e11-bf1c-7c6c0ea5db1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:53.006378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71ddee-ef8f-4e11-bf1c-7c6c0ea5db1f admin admin] PATH_INFO: `/v3/projects/30f38e0bf9964f6b9432b3400e3a2ea5/users/7f2116ba2ea345e8a9b1945e66a8c836/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:53.009005 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993186a3-3a17-4d95-9a81-ca31605ffbf5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:53.019812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993186a3-3a17-4d95-9a81-ca31605ffbf5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:53.020018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71ddee-ef8f-4e11-bf1c-7c6c0ea5db1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f38e0bf9964f6b9432b3400e3a2ea5, user_id=7f2116ba2ea345e8a9b1945e66a8c836, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:53.023225 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71ddee-ef8f-4e11-bf1c-7c6c0ea5db1f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:53.025748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24406b0b-d9dd-47ab-bae5-b1137b4958dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:53.026457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24406b0b-d9dd-47ab-bae5-b1137b4958dc admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:53.026749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24406b0b-d9dd-47ab-bae5-b1137b4958dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:53.027030 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24406b0b-d9dd-47ab-bae5-b1137b4958dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:53.027740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24406b0b-d9dd-47ab-bae5-b1137b4958dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:53.029973 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24406b0b-d9dd-47ab-bae5-b1137b4958dc admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:53.039549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1136/2285] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:52 2021] PUT /identity/v3/projects/30f38e0bf9964f6b9432b3400e3a2ea5/users/7f2116ba2ea345e8a9b1945e66a8c836/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:53.052050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b50a-d615-43ce-9c1c-8b30abb0b047 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:53.052507 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b50a-d615-43ce-9c1c-8b30abb0b047 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:53.052791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b50a-d615-43ce-9c1c-8b30abb0b047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:53.070641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1150/2286] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:53 2021] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:10:53.075639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24406b0b-d9dd-47ab-bae5-b1137b4958dc admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:53.089653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-a9a7b50a-d615-43ce-9c1c-8b30abb0b047 None None] MFA Rules not processed for user `7f2116ba2ea345e8a9b1945e66a8c836`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:53.091016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a9a7b50a-d615-43ce-9c1c-8b30abb0b047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:53.154896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24406b0b-d9dd-47ab-bae5-b1137b4958dc admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:53.160300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed253a6-359d-41a5-a43f-d25a49edb201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:53.160983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed253a6-359d-41a5-a43f-d25a49edb201 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:53.161268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed253a6-359d-41a5-a43f-d25a49edb201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:53.161539 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed253a6-359d-41a5-a43f-d25a49edb201 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:53.162247 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed253a6-359d-41a5-a43f-d25a49edb201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:53.164304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed253a6-359d-41a5-a43f-d25a49edb201 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:53.169704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1137/2287] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:53 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:53.181943 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7b50a-d615-43ce-9c1c-8b30abb0b047 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:53.183499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a9a7b50a-d615-43ce-9c1c-8b30abb0b047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:53.190886 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1151/2288] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:53 2021] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:10:53.191952 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed253a6-359d-41a5-a43f-d25a49edb201 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:53.203316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed253a6-359d-41a5-a43f-d25a49edb201 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:53.209395 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc021ae-d73c-48eb-9421-8e14cb3fb679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:53.210226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc021ae-d73c-48eb-9421-8e14cb3fb679 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:53.210705 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc021ae-d73c-48eb-9421-8e14cb3fb679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:53.211026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc021ae-d73c-48eb-9421-8e14cb3fb679 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:53.211798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc021ae-d73c-48eb-9421-8e14cb3fb679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:53.213660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc021ae-d73c-48eb-9421-8e14cb3fb679 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:53.223803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1152/2289] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:53.228426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc021ae-d73c-48eb-9421-8e14cb3fb679 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:53.237714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc021ae-d73c-48eb-9421-8e14cb3fb679 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:53.244462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059903f-40c2-47bc-b22a-f26c30678ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:53.246147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059903f-40c2-47bc-b22a-f26c30678ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:53.246311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7b50a-d615-43ce-9c1c-8b30abb0b047 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:53.246813 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059903f-40c2-47bc-b22a-f26c30678ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:53.246933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059903f-40c2-47bc-b22a-f26c30678ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:53.248244 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059903f-40c2-47bc-b22a-f26c30678ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:53.251092 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63b293-e4c3-4881-a1b1-a5fdbf42b50b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d001733477f499e937ba90e7e50ba33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:53.251213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059903f-40c2-47bc-b22a-f26c30678ac7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:53.251731 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63b293-e4c3-4881-a1b1-a5fdbf42b50b service glance] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:53.252017 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63b293-e4c3-4881-a1b1-a5fdbf42b50b service glance] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:53.252337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63b293-e4c3-4881-a1b1-a5fdbf42b50b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:53.261491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63b293-e4c3-4881-a1b1-a5fdbf42b50b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:53.262636 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1153/2290] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:53 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:53.263130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63b293-e4c3-4881-a1b1-a5fdbf42b50b service glance] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:53.266666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059903f-40c2-47bc-b22a-f26c30678ac7 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:53.273386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1138/2291] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:53 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:10:53.277519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059903f-40c2-47bc-b22a-f26c30678ac7 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:53.282681 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294cd5e-f632-4690-90b0-c0474a2ba239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:53.283607 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294cd5e-f632-4690-90b0-c0474a2ba239 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:53.284019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294cd5e-f632-4690-90b0-c0474a2ba239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:53.284304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294cd5e-f632-4690-90b0-c0474a2ba239 admin admin] PATH_INFO: `/v3/projects/a00edc9fc6a744efa5c33e63db2a7eb2/users/7b9f193140654d6b9e2efbae04524b57/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:53.300919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294cd5e-f632-4690-90b0-c0474a2ba239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00edc9fc6a744efa5c33e63db2a7eb2, user_id=7b9f193140654d6b9e2efbae04524b57, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:53.303887 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294cd5e-f632-4690-90b0-c0474a2ba239 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:53.317461 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1154/2292] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:53 2021] PUT /identity/v3/projects/a00edc9fc6a744efa5c33e63db2a7eb2/users/7b9f193140654d6b9e2efbae04524b57/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:53.322956 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b1818-f1fd-4208-94fe-b196a26f40fb None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:53.323247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b1818-f1fd-4208-94fe-b196a26f40fb None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:53.323559 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b1818-f1fd-4208-94fe-b196a26f40fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:53.342278 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d93b1818-f1fd-4208-94fe-b196a26f40fb None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:53.350672 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d93b1818-f1fd-4208-94fe-b196a26f40fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:53.423307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1139/2293] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:53.437484 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294cd5e-f632-4690-90b0-c0474a2ba239 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:53.440017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9294cd5e-f632-4690-90b0-c0474a2ba239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:53.524170 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294cd5e-f632-4690-90b0-c0474a2ba239 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:53.528501 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5463-f08f-4d6d-a58f-670ec8f2d79c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:53.529387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5463-f08f-4d6d-a58f-670ec8f2d79c service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:53.529568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5463-f08f-4d6d-a58f-670ec8f2d79c service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:53.529852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5463-f08f-4d6d-a58f-670ec8f2d79c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:53.542032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f5463-f08f-4d6d-a58f-670ec8f2d79c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:53.543507 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f5463-f08f-4d6d-a58f-670ec8f2d79c service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:53.554007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1155/2294] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:54.004868 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b1818-f1fd-4208-94fe-b196a26f40fb None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:54.007872 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d93b1818-f1fd-4208-94fe-b196a26f40fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:54.026170 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b1818-f1fd-4208-94fe-b196a26f40fb None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:54.033414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:54.034512 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:54.035123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:54.035418 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] PATH_INFO: `/v3/users/e96b0e3275a24ff18c1a93f3cd61d554` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:54.036785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96b0e3275a24ff18c1a93f3cd61d554)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:54.039407 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:54.139574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96b0e3275a24ff18c1a93f3cd61d554'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:54.158519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96b0e3275a24ff18c1a93f3cd61d554'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:54.159942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96b0e3275a24ff18c1a93f3cd61d554'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:54.160712 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96b0e3275a24ff18c1a93f3cd61d554'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:54.217811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96b0e3275a24ff18c1a93f3cd61d554'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:54.245174 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1140/2295] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:10:54 2021] DELETE /identity/v3/users/e96b0e3275a24ff18c1a93f3cd61d554 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:54.249959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec774-4947-4f09-9bf1-2d752985299b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:54.250485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec774-4947-4f09-9bf1-2d752985299b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:54.251050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec774-4947-4f09-9bf1-2d752985299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:54.272929 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-b57ec774-4947-4f09-9bf1-2d752985299b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:54.275634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b57ec774-4947-4f09-9bf1-2d752985299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:54.365633 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1156/2296] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:54.377889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:54.380059 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:54.463658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5b811-9635-4054-84da-92865efec8b5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:54.468446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf05c75-2136-4ab6-b289-70478120b516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:54.469962 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf05c75-2136-4ab6-b289-70478120b516 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:54.470439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf05c75-2136-4ab6-b289-70478120b516 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:54.470794 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf05c75-2136-4ab6-b289-70478120b516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:54.489648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf05c75-2136-4ab6-b289-70478120b516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:54.491163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf05c75-2136-4ab6-b289-70478120b516 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:54.505864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1141/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:54.578438 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24b331-cbf7-4364-a278-f72ed4939708 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:54.579404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24b331-cbf7-4364-a278-f72ed4939708 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:54.579775 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24b331-cbf7-4364-a278-f72ed4939708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:54.609606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ed24b331-cbf7-4364-a278-f72ed4939708 None None] MFA Rules not processed for user `7b9f193140654d6b9e2efbae04524b57`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:54.611206 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ed24b331-cbf7-4364-a278-f72ed4939708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:54.697747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1157/2298] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:54 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:10:54.707340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf05c75-2136-4ab6-b289-70478120b516 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:54.708731 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-acf05c75-2136-4ab6-b289-70478120b516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:54.801495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf05c75-2136-4ab6-b289-70478120b516 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:54.805852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665197-2f05-44ba-8cb0-ed2053c9a3db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:54.806623 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665197-2f05-44ba-8cb0-ed2053c9a3db service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:54.807034 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665197-2f05-44ba-8cb0-ed2053c9a3db service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:54.807827 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665197-2f05-44ba-8cb0-ed2053c9a3db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:54.820580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665197-2f05-44ba-8cb0-ed2053c9a3db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:54.822737 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665197-2f05-44ba-8cb0-ed2053c9a3db service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:54.838984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1142/2299] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:54 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:10:54.859984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24b331-cbf7-4364-a278-f72ed4939708 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:54.861411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ed24b331-cbf7-4364-a278-f72ed4939708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:54.876780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24b331-cbf7-4364-a278-f72ed4939708 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:54.883830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511a1aa-049a-4df5-b621-810efc77c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:54.884961 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511a1aa-049a-4df5-b621-810efc77c7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:54.885402 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511a1aa-049a-4df5-b621-810efc77c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:54.885835 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511a1aa-049a-4df5-b621-810efc77c7d3 admin admin] PATH_INFO: `/v3/projects/4c568974164940cc8e40d18a9c7ba1bb` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:54.890855 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511a1aa-049a-4df5-b621-810efc77c7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c568974164940cc8e40d18a9c7ba1bb)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:54.893813 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511a1aa-049a-4df5-b621-810efc77c7d3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:54.950827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d511a1aa-049a-4df5-b621-810efc77c7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c568974164940cc8e40d18a9c7ba1bb', 'request_id': 'req-d511a1aa-049a-4df5-b621-810efc77c7d3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:54.957897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d511a1aa-049a-4df5-b621-810efc77c7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c568974164940cc8e40d18a9c7ba1bb', 'request_id': 'req-d511a1aa-049a-4df5-b621-810efc77c7d3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:54.968981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d511a1aa-049a-4df5-b621-810efc77c7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c568974164940cc8e40d18a9c7ba1bb', 'request_id': 'req-d511a1aa-049a-4df5-b621-810efc77c7d3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:54.984551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d511a1aa-049a-4df5-b621-810efc77c7d3 admin admin] The token cache is being invalidate because project 4c568974164940cc8e40d18a9c7ba1bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:10:54.985105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d511a1aa-049a-4df5-b621-810efc77c7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:54.986187 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d511a1aa-049a-4df5-b621-810efc77c7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:10:54.990449 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1158/2300] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:10:54 2021] DELETE /identity/v3/projects/4c568974164940cc8e40d18a9c7ba1bb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:54.995074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645511b-176b-4406-955b-646502ae8d0b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:54.995482 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645511b-176b-4406-955b-646502ae8d0b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:54.995667 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645511b-176b-4406-955b-646502ae8d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:55.024053 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d645511b-176b-4406-955b-646502ae8d0b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:55.025437 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d645511b-176b-4406-955b-646502ae8d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:55.122569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1143/2301] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:55.124453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c24900-9739-4a30-83d0-7469cde30e3c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:55.124964 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c24900-9739-4a30-83d0-7469cde30e3c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:55.125343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c24900-9739-4a30-83d0-7469cde30e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:55.146854 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d0c24900-9739-4a30-83d0-7469cde30e3c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:55.148535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d0c24900-9739-4a30-83d0-7469cde30e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:55.161486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645511b-176b-4406-955b-646502ae8d0b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:55.170107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1159/2302] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:55.172888 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645511b-176b-4406-955b-646502ae8d0b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:55.179640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a950d-0755-449d-922b-357709abd92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:55.180590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a950d-0755-449d-922b-357709abd92e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:55.180991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a950d-0755-449d-922b-357709abd92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:55.181366 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a950d-0755-449d-922b-357709abd92e admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:55.182225 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a950d-0755-449d-922b-357709abd92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:10:55.182657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a950d-0755-449d-922b-357709abd92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:55.184643 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a950d-0755-449d-922b-357709abd92e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:55.206790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c24900-9739-4a30-83d0-7469cde30e3c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:55.216771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c24900-9739-4a30-83d0-7469cde30e3c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:55.217231 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1144/2303] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:10:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:10:55.222718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2f29b-0c4f-44e6-adb1-96098c82a322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:55.223538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2f29b-0c4f-44e6-adb1-96098c82a322 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:55.224133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2f29b-0c4f-44e6-adb1-96098c82a322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:55.224583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2f29b-0c4f-44e6-adb1-96098c82a322 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:55.225688 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2f29b-0c4f-44e6-adb1-96098c82a322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:55.229311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2f29b-0c4f-44e6-adb1-96098c82a322 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:55.274933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1160/2304] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:55 2021] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:10:55.276146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a950d-0755-449d-922b-357709abd92e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:55.286646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a950d-0755-449d-922b-357709abd92e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:55.363035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c96be4-473a-4166-8a02-1818737cf1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:55.363900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c96be4-473a-4166-8a02-1818737cf1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:55.364337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c96be4-473a-4166-8a02-1818737cf1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:55.364611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c96be4-473a-4166-8a02-1818737cf1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:55.365459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c96be4-473a-4166-8a02-1818737cf1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:55.368503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c96be4-473a-4166-8a02-1818737cf1b9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:55.389601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1145/2305] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:55 2021] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:10:55.394329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2f29b-0c4f-44e6-adb1-96098c82a322 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:55.409887 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2f29b-0c4f-44e6-adb1-96098c82a322 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:55.415100 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a0997-cf62-424c-9759-a58813ef6f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:55.415776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a0997-cf62-424c-9759-a58813ef6f47 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:55.416063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a0997-cf62-424c-9759-a58813ef6f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:55.416337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a0997-cf62-424c-9759-a58813ef6f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:55.417087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a0997-cf62-424c-9759-a58813ef6f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:55.418722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a0997-cf62-424c-9759-a58813ef6f47 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:55.431279 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1161/2306] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:55 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:55.435356 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c96be4-473a-4166-8a02-1818737cf1b9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:55.445198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c96be4-473a-4166-8a02-1818737cf1b9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:55.450149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae456d33-2c21-47e4-b7b8-2eaf912b568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:55.450844 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae456d33-2c21-47e4-b7b8-2eaf912b568a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:55.451129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae456d33-2c21-47e4-b7b8-2eaf912b568a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:55.451408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae456d33-2c21-47e4-b7b8-2eaf912b568a admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:55.452148 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae456d33-2c21-47e4-b7b8-2eaf912b568a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:55.453738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae456d33-2c21-47e4-b7b8-2eaf912b568a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:55.464880 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1146/2307] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:55.470231 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a0997-cf62-424c-9759-a58813ef6f47 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:55.480973 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a0997-cf62-424c-9759-a58813ef6f47 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:55.485698 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12772a98-57fa-4be7-8d89-00b377b20897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:55.486677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12772a98-57fa-4be7-8d89-00b377b20897 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:55.486960 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12772a98-57fa-4be7-8d89-00b377b20897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:55.487265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12772a98-57fa-4be7-8d89-00b377b20897 admin admin] PATH_INFO: `/v3/projects/183f046eb85f4cd0b2268597304b51e4/users/07180ed0c8f343048233d308a29937ca/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:55.503033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12772a98-57fa-4be7-8d89-00b377b20897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183f046eb85f4cd0b2268597304b51e4, user_id=07180ed0c8f343048233d308a29937ca, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:55.505553 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12772a98-57fa-4be7-8d89-00b377b20897 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:55.524474 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1162/2308] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:55 2021] PUT /identity/v3/projects/183f046eb85f4cd0b2268597304b51e4/users/07180ed0c8f343048233d308a29937ca/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:10:55.537238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4b6d-10c3-4685-aaea-fc1942fa30b8 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:55.538132 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4b6d-10c3-4685-aaea-fc1942fa30b8 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:55.538463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4b6d-10c3-4685-aaea-fc1942fa30b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:55.567027 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-adff4b6d-10c3-4685-aaea-fc1942fa30b8 None None] MFA Rules not processed for user `07180ed0c8f343048233d308a29937ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:55.568244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-adff4b6d-10c3-4685-aaea-fc1942fa30b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:55.652989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1147/2309] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:55 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:55.657674 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12772a98-57fa-4be7-8d89-00b377b20897 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:55.737538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12772a98-57fa-4be7-8d89-00b377b20897 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:55.746008 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b812cf-900a-4685-bf2d-81eaed7cacb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:55.746790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b812cf-900a-4685-bf2d-81eaed7cacb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:55.747150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b812cf-900a-4685-bf2d-81eaed7cacb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:55.747484 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b812cf-900a-4685-bf2d-81eaed7cacb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:55.748267 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b812cf-900a-4685-bf2d-81eaed7cacb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:55.750387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b812cf-900a-4685-bf2d-81eaed7cacb8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:55.779733 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1163/2310] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:55 2021] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:55.783548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff4b6d-10c3-4685-aaea-fc1942fa30b8 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:55.795174 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff4b6d-10c3-4685-aaea-fc1942fa30b8 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:55.892924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c8e44-0ae9-42c0-8146-fc122d32ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:55.893657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8e44-0ae9-42c0-8146-fc122d32ae45 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:55.893997 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8e44-0ae9-42c0-8146-fc122d32ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:55.894330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8e44-0ae9-42c0-8146-fc122d32ae45 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:55.895141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c8e44-0ae9-42c0-8146-fc122d32ae45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:55.898289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c8e44-0ae9-42c0-8146-fc122d32ae45 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:55.923741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1148/2311] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:55 2021] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:10:55.934992 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b812cf-900a-4685-bf2d-81eaed7cacb8 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:55.948509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b812cf-900a-4685-bf2d-81eaed7cacb8 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:55.953859 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893d62f-a353-481d-a2ec-70b88c4c93b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:55.954716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893d62f-a353-481d-a2ec-70b88c4c93b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:55.955605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893d62f-a353-481d-a2ec-70b88c4c93b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:55.955874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893d62f-a353-481d-a2ec-70b88c4c93b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:55.956630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893d62f-a353-481d-a2ec-70b88c4c93b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:55.958468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893d62f-a353-481d-a2ec-70b88c4c93b3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:55.971625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1164/2312] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:55 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:55.976779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c8e44-0ae9-42c0-8146-fc122d32ae45 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:55.995683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c8e44-0ae9-42c0-8146-fc122d32ae45 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:56.001462 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e85ac-f975-47c0-a586-7c9dc30ea362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:56.002310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e85ac-f975-47c0-a586-7c9dc30ea362 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:56.002740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e85ac-f975-47c0-a586-7c9dc30ea362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:56.003001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e85ac-f975-47c0-a586-7c9dc30ea362 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:56.009359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e85ac-f975-47c0-a586-7c9dc30ea362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:56.012138 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e85ac-f975-47c0-a586-7c9dc30ea362 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:56.030450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1149/2313] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:55 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:56.032007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893d62f-a353-481d-a2ec-70b88c4c93b3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:56.046647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893d62f-a353-481d-a2ec-70b88c4c93b3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:56.052897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39021d6-be99-4d93-a2d2-54309547c85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:56.053378 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39021d6-be99-4d93-a2d2-54309547c85d admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:56.053624 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39021d6-be99-4d93-a2d2-54309547c85d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:56.055676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39021d6-be99-4d93-a2d2-54309547c85d admin admin] PATH_INFO: `/v3/projects/5180cb2b62b14050acf9b0a81cefdf76/users/9fc9c261027b4f31b66588a83dcffc72/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:56.075486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39021d6-be99-4d93-a2d2-54309547c85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5180cb2b62b14050acf9b0a81cefdf76, user_id=9fc9c261027b4f31b66588a83dcffc72, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:56.078409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39021d6-be99-4d93-a2d2-54309547c85d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:56.099519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1165/2314] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:56 2021] PUT /identity/v3/projects/5180cb2b62b14050acf9b0a81cefdf76/users/9fc9c261027b4f31b66588a83dcffc72/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:56.110324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de818b-766e-4a25-b633-9b83570613e1 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:56.110871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de818b-766e-4a25-b633-9b83570613e1 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:56.111351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de818b-766e-4a25-b633-9b83570613e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:56.146537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c3de818b-766e-4a25-b633-9b83570613e1 None None] MFA Rules not processed for user `9fc9c261027b4f31b66588a83dcffc72`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:56.150063 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c3de818b-766e-4a25-b633-9b83570613e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:56.230414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1150/2315] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:56 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:56.234822 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39021d6-be99-4d93-a2d2-54309547c85d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:56.346952 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39021d6-be99-4d93-a2d2-54309547c85d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:56.358155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6cfaf-1a10-4ba2-8dd8-116f26899c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:56.359438 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6cfaf-1a10-4ba2-8dd8-116f26899c33 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:56.359841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6cfaf-1a10-4ba2-8dd8-116f26899c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:56.360235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6cfaf-1a10-4ba2-8dd8-116f26899c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:56.361165 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6cfaf-1a10-4ba2-8dd8-116f26899c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:56.364805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6cfaf-1a10-4ba2-8dd8-116f26899c33 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:56.365232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb35f16-2b03-4ee3-8bdc-96a4475c4eff None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:56.365801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb35f16-2b03-4ee3-8bdc-96a4475c4eff None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:56.366467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb35f16-2b03-4ee3-8bdc-96a4475c4eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:56.403657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-deb35f16-2b03-4ee3-8bdc-96a4475c4eff None None] MFA Rules not processed for user `7b9f193140654d6b9e2efbae04524b57`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:56.405016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-deb35f16-2b03-4ee3-8bdc-96a4475c4eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:56.442830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1166/2316] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:10:56 2021] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:10:56.447260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6cfaf-1a10-4ba2-8dd8-116f26899c33 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:56.520137 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1151/2317] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:56 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:56.613508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6cfaf-1a10-4ba2-8dd8-116f26899c33 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:56.629637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8c3ef-aff3-4005-836a-4eadb1c91ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:56.630592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8c3ef-aff3-4005-836a-4eadb1c91ecc admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:56.636470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8c3ef-aff3-4005-836a-4eadb1c91ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:56.636772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8c3ef-aff3-4005-836a-4eadb1c91ecc admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:56.637521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8c3ef-aff3-4005-836a-4eadb1c91ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:56.639593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8c3ef-aff3-4005-836a-4eadb1c91ecc admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:56.688937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1167/2318] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:10:56 2021] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:10:56.690261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb35f16-2b03-4ee3-8bdc-96a4475c4eff None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:56.712286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb35f16-2b03-4ee3-8bdc-96a4475c4eff None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:56.715558 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e2c37-660d-435a-a3e1-76302295ca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:56.716242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e2c37-660d-435a-a3e1-76302295ca7d admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:56.716520 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e2c37-660d-435a-a3e1-76302295ca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:56.716792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e2c37-660d-435a-a3e1-76302295ca7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:56.717534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e2c37-660d-435a-a3e1-76302295ca7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:56.719624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e2c37-660d-435a-a3e1-76302295ca7d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:56.730889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1152/2319] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:56 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:10:56.735082 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8c3ef-aff3-4005-836a-4eadb1c91ecc admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:56.745089 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8c3ef-aff3-4005-836a-4eadb1c91ecc admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:56.749692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c57a4a-e771-4fad-9729-34aef21fc360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:56.750642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c57a4a-e771-4fad-9729-34aef21fc360 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:56.750922 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c57a4a-e771-4fad-9729-34aef21fc360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:56.751192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c57a4a-e771-4fad-9729-34aef21fc360 admin admin] PATH_INFO: `/v3/projects/258a17e01b07454fa571961e1125db6b/users/4849a511e44d4d69aef75855b29bbc46/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:56.765931 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c57a4a-e771-4fad-9729-34aef21fc360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258a17e01b07454fa571961e1125db6b, user_id=4849a511e44d4d69aef75855b29bbc46, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:56.768577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c57a4a-e771-4fad-9729-34aef21fc360 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:56.785150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1168/2320] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:56 2021] PUT /identity/v3/projects/258a17e01b07454fa571961e1125db6b/users/4849a511e44d4d69aef75855b29bbc46/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:56.789787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e2c37-660d-435a-a3e1-76302295ca7d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:56.801715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e2c37-660d-435a-a3e1-76302295ca7d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:56.870978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dcc78-0ed4-4864-9bfb-630cddf3ac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:56.871905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dcc78-0ed4-4864-9bfb-630cddf3ac7f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:56.872193 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dcc78-0ed4-4864-9bfb-630cddf3ac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:56.872491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dcc78-0ed4-4864-9bfb-630cddf3ac7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:56.873244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dcc78-0ed4-4864-9bfb-630cddf3ac7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:56.874913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dcc78-0ed4-4864-9bfb-630cddf3ac7f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:56.886334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1153/2321] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:10:56 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:10:56.890349 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c57a4a-e771-4fad-9729-34aef21fc360 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:56.902718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c57a4a-e771-4fad-9729-34aef21fc360 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:56.911430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831143ef-13a5-46c4-8ae5-fcef7c33d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:56.912559 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831143ef-13a5-46c4-8ae5-fcef7c33d957 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:56.912855 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831143ef-13a5-46c4-8ae5-fcef7c33d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:56.913284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831143ef-13a5-46c4-8ae5-fcef7c33d957 admin admin] PATH_INFO: `/v3/projects/258a17e01b07454fa571961e1125db6b/users/4849a511e44d4d69aef75855b29bbc46/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:56.917233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831143ef-13a5-46c4-8ae5-fcef7c33d957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258a17e01b07454fa571961e1125db6b, user_id=4849a511e44d4d69aef75855b29bbc46, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:56.920048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831143ef-13a5-46c4-8ae5-fcef7c33d957 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:56.934738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1169/2322] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:10:56 2021] PUT /identity/v3/projects/258a17e01b07454fa571961e1125db6b/users/4849a511e44d4d69aef75855b29bbc46/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:10:56.946100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc0667-f980-4e8c-b731-e1acf7875732 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:56.946655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc0667-f980-4e8c-b731-e1acf7875732 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:56.946969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc0667-f980-4e8c-b731-e1acf7875732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:56.988460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e4cc0667-f980-4e8c-b731-e1acf7875732 None None] MFA Rules not processed for user `4849a511e44d4d69aef75855b29bbc46`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:10:56.989819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e4cc0667-f980-4e8c-b731-e1acf7875732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:57.080368 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1154/2323] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:10:56 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:10:57.111242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831143ef-13a5-46c4-8ae5-fcef7c33d957 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:57.113744 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-831143ef-13a5-46c4-8ae5-fcef7c33d957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:57.197449 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831143ef-13a5-46c4-8ae5-fcef7c33d957 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:57.202092 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeeec2-7044-4fab-9980-b2fffd1c6095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:57.203041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeeec2-7044-4fab-9980-b2fffd1c6095 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:57.203330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeeec2-7044-4fab-9980-b2fffd1c6095 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:57.204491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeeec2-7044-4fab-9980-b2fffd1c6095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:57.301214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaeeec2-7044-4fab-9980-b2fffd1c6095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:57.302778 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaeeec2-7044-4fab-9980-b2fffd1c6095 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:57.330356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1170/2324] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:57 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:58.892208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc0667-f980-4e8c-b731-e1acf7875732 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:58.893708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e4cc0667-f980-4e8c-b731-e1acf7875732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:10:58.907596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc0667-f980-4e8c-b731-e1acf7875732 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:58.913128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ce111-3602-4218-bb53-c26cb03d8556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:58.914827 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ce111-3602-4218-bb53-c26cb03d8556 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:58.915261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ce111-3602-4218-bb53-c26cb03d8556 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:58.915796 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ce111-3602-4218-bb53-c26cb03d8556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:58.985410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ce111-3602-4218-bb53-c26cb03d8556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:58.987572 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ce111-3602-4218-bb53-c26cb03d8556 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:59.004307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1155/2325] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:58 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:10:59.732050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeeec2-7044-4fab-9980-b2fffd1c6095 service cinder] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:10:59.744320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeeec2-7044-4fab-9980-b2fffd1c6095 service cinder] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:10:59.754842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e935570-f225-4b01-96f7-e3f4e58da721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:10:59.754842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e935570-f225-4b01-96f7-e3f4e58da721 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:10:59.754842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e935570-f225-4b01-96f7-e3f4e58da721 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:10:59.754842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e935570-f225-4b01-96f7-e3f4e58da721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:10:59.774020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e935570-f225-4b01-96f7-e3f4e58da721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:10:59.776755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e935570-f225-4b01-96f7-e3f4e58da721 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:10:59.804204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1171/2326] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:10:59 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:11:03.788735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ce111-3602-4218-bb53-c26cb03d8556 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:11:03.863820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ce111-3602-4218-bb53-c26cb03d8556 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:11:03.868778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:11:03.869665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:03.869938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:03.870217 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] PATH_INFO: `/v3/users/07180ed0c8f343048233d308a29937ca` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:03.871452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07180ed0c8f343048233d308a29937ca)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:11:03.873353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:11:03.923885 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07180ed0c8f343048233d308a29937ca'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:03.931499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07180ed0c8f343048233d308a29937ca'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:03.932171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07180ed0c8f343048233d308a29937ca'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:03.932784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07180ed0c8f343048233d308a29937ca'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:03.944527 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07180ed0c8f343048233d308a29937ca'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:03.958397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1156/2327] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:11:03 2021] DELETE /identity/v3/users/07180ed0c8f343048233d308a29937ca => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:11:03.963256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2446e6-fe68-42c5-8994-fa5451a1d8b6 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:03.963734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2446e6-fe68-42c5-8994-fa5451a1d8b6 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:03.963828 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2446e6-fe68-42c5-8994-fa5451a1d8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:03.981914 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-4f2446e6-fe68-42c5-8994-fa5451a1d8b6 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:11:03.983228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-4f2446e6-fe68-42c5-8994-fa5451a1d8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:04.042564 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1172/2328] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:11:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:11:04.053166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:11:04.055776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:04.114738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4c1c6-0640-4eae-a2c1-d13fc5726318 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:11:04.118877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64536-2fcf-49bf-822c-ee4b7e603fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:11:04.119519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64536-2fcf-49bf-822c-ee4b7e603fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:04.119790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64536-2fcf-49bf-822c-ee4b7e603fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:04.120062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64536-2fcf-49bf-822c-ee4b7e603fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:04.129245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f64536-2fcf-49bf-822c-ee4b7e603fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:11:04.130728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f64536-2fcf-49bf-822c-ee4b7e603fd6 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:11:04.141165 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1157/2329] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:11:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:11:04.435224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2446e6-fe68-42c5-8994-fa5451a1d8b6 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:11:04.437010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-4f2446e6-fe68-42c5-8994-fa5451a1d8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:04.451455 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2446e6-fe68-42c5-8994-fa5451a1d8b6 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:11:04.456246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:11:04.457210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:04.457595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:04.458053 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] PATH_INFO: `/v3/projects/183f046eb85f4cd0b2268597304b51e4` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:04.459325 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183f046eb85f4cd0b2268597304b51e4)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:11:04.464323 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:11:04.518992 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183f046eb85f4cd0b2268597304b51e4', 'request_id': 'req-1484dec9-5ee6-4a36-af23-62f9c19bf805'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:04.526417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183f046eb85f4cd0b2268597304b51e4', 'request_id': 'req-1484dec9-5ee6-4a36-af23-62f9c19bf805'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:04.535136 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183f046eb85f4cd0b2268597304b51e4', 'request_id': 'req-1484dec9-5ee6-4a36-af23-62f9c19bf805'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:04.557741 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] The token cache is being invalidate because project 183f046eb85f4cd0b2268597304b51e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:11:04.558040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:04.558851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:04.560418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1173/2330] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:11:04 2021] DELETE /identity/v3/projects/183f046eb85f4cd0b2268597304b51e4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:11:04.565020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64536-2fcf-49bf-822c-ee4b7e603fd6 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:11:04.575863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64536-2fcf-49bf-822c-ee4b7e603fd6 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:11:04.636491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:11:04.637360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:04.637635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:04.637902 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] PATH_INFO: `/v3/users/9fc9c261027b4f31b66588a83dcffc72` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:04.639122 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc9c261027b4f31b66588a83dcffc72)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:11:04.641268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:11:04.691565 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc9c261027b4f31b66588a83dcffc72'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:04.698926 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc9c261027b4f31b66588a83dcffc72'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:04.699633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc9c261027b4f31b66588a83dcffc72'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:04.700348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc9c261027b4f31b66588a83dcffc72'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:04.712797 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc9c261027b4f31b66588a83dcffc72'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:04.729367 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1158/2331] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:11:04 2021] DELETE /identity/v3/users/9fc9c261027b4f31b66588a83dcffc72 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:11:05.020162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:11:05.021683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:05.038007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484dec9-5ee6-4a36-af23-62f9c19bf805 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:11:05.097460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:11:05.098311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:05.098622 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:05.098897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] PATH_INFO: `/v3/projects/5180cb2b62b14050acf9b0a81cefdf76` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:05.100100 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5180cb2b62b14050acf9b0a81cefdf76)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:11:05.102054 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:11:05.153742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5180cb2b62b14050acf9b0a81cefdf76', 'request_id': 'req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.159884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5180cb2b62b14050acf9b0a81cefdf76', 'request_id': 'req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.170047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5180cb2b62b14050acf9b0a81cefdf76', 'request_id': 'req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.182599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] The token cache is being invalidate because project 5180cb2b62b14050acf9b0a81cefdf76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:11:05.182892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.183538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.185112 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1174/2332] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:11:05 2021] DELETE /identity/v3/projects/5180cb2b62b14050acf9b0a81cefdf76 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:11:05.189198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:11:05.190623 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:05.203588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc095037-c2d7-49dc-abcf-d35e147e48eb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:11:05.269743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef442ab-e4e6-4345-aa09-61528a2d4988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:11:05.270652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef442ab-e4e6-4345-aa09-61528a2d4988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:05.270931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef442ab-e4e6-4345-aa09-61528a2d4988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:05.271202 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef442ab-e4e6-4345-aa09-61528a2d4988 admin admin] PATH_INFO: `/v3/users/4849a511e44d4d69aef75855b29bbc46` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:05.272462 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef442ab-e4e6-4345-aa09-61528a2d4988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4849a511e44d4d69aef75855b29bbc46)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:11:05.274585 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef442ab-e4e6-4345-aa09-61528a2d4988 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:11:05.333476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-eef442ab-e4e6-4345-aa09-61528a2d4988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4849a511e44d4d69aef75855b29bbc46'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.337642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-eef442ab-e4e6-4345-aa09-61528a2d4988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4849a511e44d4d69aef75855b29bbc46'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.338648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-eef442ab-e4e6-4345-aa09-61528a2d4988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4849a511e44d4d69aef75855b29bbc46'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.339461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-eef442ab-e4e6-4345-aa09-61528a2d4988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4849a511e44d4d69aef75855b29bbc46'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.355042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-eef442ab-e4e6-4345-aa09-61528a2d4988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4849a511e44d4d69aef75855b29bbc46'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.369890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1159/2333] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:11:05 2021] DELETE /identity/v3/users/4849a511e44d4d69aef75855b29bbc46 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:11:05.707321 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:11:05.708896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:05.743981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225604a-8ec5-4c54-adbe-e55ffb85c7e0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:11:05.861797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:11:05.862847 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:05.863485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:05.864029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] PATH_INFO: `/v3/projects/258a17e01b07454fa571961e1125db6b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:05.866517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258a17e01b07454fa571961e1125db6b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:11:05.870113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:11:05.963046 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258a17e01b07454fa571961e1125db6b', 'request_id': 'req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.970201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258a17e01b07454fa571961e1125db6b', 'request_id': 'req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.983361 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258a17e01b07454fa571961e1125db6b', 'request_id': 'req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.991907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] The token cache is being invalidate because project 258a17e01b07454fa571961e1125db6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:11:05.992197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.993026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:05.994758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1175/2334] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:11:05 2021] DELETE /identity/v3/projects/258a17e01b07454fa571961e1125db6b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:11:08.670003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617546e-c6d5-4d6e-84dd-6b7602102ef3 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:08.670576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617546e-c6d5-4d6e-84dd-6b7602102ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:08.670576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617546e-c6d5-4d6e-84dd-6b7602102ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:08.690740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-2617546e-c6d5-4d6e-84dd-6b7602102ef3 None None] MFA Rules not processed for user `d0b8bb5afcbc4159b3f6256d8fe93997`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:11:08.691952 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2617546e-c6d5-4d6e-84dd-6b7602102ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:08.754198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1160/2335] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:11:08 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:11:13.092428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:11:13.094120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:13.175304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5796da-dbfd-463f-ac5f-9ccb4976f5c0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:11:13.179958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4235c3-6b78-4ece-9263-68200fba5dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:11:13.181243 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4235c3-6b78-4ece-9263-68200fba5dcb service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:13.181528 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4235c3-6b78-4ece-9263-68200fba5dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:13.181948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4235c3-6b78-4ece-9263-68200fba5dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:13.184377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cf4235c3-6b78-4ece-9263-68200fba5dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:13.272986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4235c3-6b78-4ece-9263-68200fba5dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:11:13.275715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4235c3-6b78-4ece-9263-68200fba5dcb service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:11:13.294198 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1176/2336] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:11:13 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:11:24.926794 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a98d3b-e9f8-4707-992f-50cfb99a22a6 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:24.927398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a98d3b-e9f8-4707-992f-50cfb99a22a6 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:24.927398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a98d3b-e9f8-4707-992f-50cfb99a22a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:24.951464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-38a98d3b-e9f8-4707-992f-50cfb99a22a6 None None] MFA Rules not processed for user `59d2b98f1809405ab307a035062400c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:11:24.953197 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-38a98d3b-e9f8-4707-992f-50cfb99a22a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:25.016408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1161/2337] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:11:24 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:11:37.245918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4235c3-6b78-4ece-9263-68200fba5dcb service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:11:37.248166 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cf4235c3-6b78-4ece-9263-68200fba5dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:37.377701 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4235c3-6b78-4ece-9263-68200fba5dcb service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:11:37.383314 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:11:37.384985 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:37.385333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:37.385812 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] PATH_INFO: `/v3/users/7f2116ba2ea345e8a9b1945e66a8c836` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:37.387033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2116ba2ea345e8a9b1945e66a8c836)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:11:37.389485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:11:37.435273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2116ba2ea345e8a9b1945e66a8c836'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:37.436042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2116ba2ea345e8a9b1945e66a8c836'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:37.442984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2116ba2ea345e8a9b1945e66a8c836'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:37.443664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2116ba2ea345e8a9b1945e66a8c836'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:37.456162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2116ba2ea345e8a9b1945e66a8c836'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:37.471721 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1177/2338] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:11:37 2021] DELETE /identity/v3/users/7f2116ba2ea345e8a9b1945e66a8c836 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:11:37.476307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cfddf-b8dd-47f2-99f1-006878485fa8 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:37.477217 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cfddf-b8dd-47f2-99f1-006878485fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:37.477217 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cfddf-b8dd-47f2-99f1-006878485fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:37.505358 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c96cfddf-b8dd-47f2-99f1-006878485fa8 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:11:37.506620 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c96cfddf-b8dd-47f2-99f1-006878485fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:37.573600 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1162/2339] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:11:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:11:37.583460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:11:37.584854 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:37.676642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a282e5c-5bca-4db7-b797-18c6d5488dd3 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:11:37.680255 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b855e2-6a03-4482-a756-d53d981cd599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:11:37.681429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b855e2-6a03-4482-a756-d53d981cd599 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:37.681721 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b855e2-6a03-4482-a756-d53d981cd599 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:37.681991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b855e2-6a03-4482-a756-d53d981cd599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:37.691708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b855e2-6a03-4482-a756-d53d981cd599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:11:37.693132 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b855e2-6a03-4482-a756-d53d981cd599 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:11:37.702411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1178/2340] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:11:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:11:37.964128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cfddf-b8dd-47f2-99f1-006878485fa8 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:11:37.966128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c96cfddf-b8dd-47f2-99f1-006878485fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:37.980381 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cfddf-b8dd-47f2-99f1-006878485fa8 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:11:37.985075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:11:37.985928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:37.986220 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:37.986510 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] PATH_INFO: `/v3/projects/30f38e0bf9964f6b9432b3400e3a2ea5` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:37.987734 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=30f38e0bf9964f6b9432b3400e3a2ea5)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:11:37.989631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:11:38.036838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30f38e0bf9964f6b9432b3400e3a2ea5', 'request_id': 'req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:38.043077 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30f38e0bf9964f6b9432b3400e3a2ea5', 'request_id': 'req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:38.049281 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30f38e0bf9964f6b9432b3400e3a2ea5', 'request_id': 'req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:38.063116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] The token cache is being invalidate because project 30f38e0bf9964f6b9432b3400e3a2ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:11:38.063378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:38.064014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:11:38.065552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1163/2341] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:11:37 2021] DELETE /identity/v3/projects/30f38e0bf9964f6b9432b3400e3a2ea5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:11:42.849034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3636f6-8847-4b44-8a2d-72d84b1d8bd6 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:42.849629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3636f6-8847-4b44-8a2d-72d84b1d8bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:42.850127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3636f6-8847-4b44-8a2d-72d84b1d8bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:42.871959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ec3636f6-8847-4b44-8a2d-72d84b1d8bd6 None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:11:42.873210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ec3636f6-8847-4b44-8a2d-72d84b1d8bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:42.941156 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1179/2342] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:11:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:11:42.988940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:11:42.990348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:11:43.068213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efab50a-e9f1-4cc3-a1c7-6eb61a711b1b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:11:43.075079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d44abf-6857-41f6-8d32-7bb8f2a9fdfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:11:43.075738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d44abf-6857-41f6-8d32-7bb8f2a9fdfd service swift] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:11:43.076017 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d44abf-6857-41f6-8d32-7bb8f2a9fdfd service swift] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:11:43.076292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d44abf-6857-41f6-8d32-7bb8f2a9fdfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:11:43.086134 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d44abf-6857-41f6-8d32-7bb8f2a9fdfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:11:43.088421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d44abf-6857-41f6-8d32-7bb8f2a9fdfd service swift] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:11:43.097300 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1164/2343] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:11:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 01:12:03.245459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb38603-e33d-4669-8278-32182669009f None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:03.245987 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb38603-e33d-4669-8278-32182669009f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:03.246093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb38603-e33d-4669-8278-32182669009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:03.273204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ceb38603-e33d-4669-8278-32182669009f None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:03.275144 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ceb38603-e33d-4669-8278-32182669009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:03.288759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1180/2344] 10.222.0.23 () {58 vars in 967 bytes} [Thu Dec 9 01:12:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:12:03.301960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d44abf-6857-41f6-8d32-7bb8f2a9fdfd service swift] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:03.312540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d44abf-6857-41f6-8d32-7bb8f2a9fdfd service swift] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:03.317438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71540f-978f-4767-b3a3-080041c6a4b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:03.318048 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71540f-978f-4767-b3a3-080041c6a4b8 service swift] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:03.318327 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71540f-978f-4767-b3a3-080041c6a4b8 service swift] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:03.318637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71540f-978f-4767-b3a3-080041c6a4b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:03.327409 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71540f-978f-4767-b3a3-080041c6a4b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:03.328950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71540f-978f-4767-b3a3-080041c6a4b8 service swift] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:03.336837 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1165/2345] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:12:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 01:12:08.394181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb38603-e33d-4669-8278-32182669009f None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:08.395798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ceb38603-e33d-4669-8278-32182669009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:08.461570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb38603-e33d-4669-8278-32182669009f None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:08.466227 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16635c73-199e-47ff-8d1e-87ae1ea6c421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:08.467379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16635c73-199e-47ff-8d1e-87ae1ea6c421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:08.467660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16635c73-199e-47ff-8d1e-87ae1ea6c421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:08.467933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16635c73-199e-47ff-8d1e-87ae1ea6c421 admin admin] PATH_INFO: `/v3/users/d0b8bb5afcbc4159b3f6256d8fe93997` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:08.469132 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16635c73-199e-47ff-8d1e-87ae1ea6c421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b8bb5afcbc4159b3f6256d8fe93997)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:08.471076 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16635c73-199e-47ff-8d1e-87ae1ea6c421 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:08.516790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-16635c73-199e-47ff-8d1e-87ae1ea6c421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b8bb5afcbc4159b3f6256d8fe93997'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:08.517437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-16635c73-199e-47ff-8d1e-87ae1ea6c421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b8bb5afcbc4159b3f6256d8fe93997'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:08.525377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-16635c73-199e-47ff-8d1e-87ae1ea6c421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b8bb5afcbc4159b3f6256d8fe93997'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:08.526051 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-16635c73-199e-47ff-8d1e-87ae1ea6c421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b8bb5afcbc4159b3f6256d8fe93997'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:08.537451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-16635c73-199e-47ff-8d1e-87ae1ea6c421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b8bb5afcbc4159b3f6256d8fe93997'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:08.549786 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1181/2346] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:12:08 2021] DELETE /identity/v3/users/d0b8bb5afcbc4159b3f6256d8fe93997 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:12:08.755536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71540f-978f-4767-b3a3-080041c6a4b8 service swift] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:08.768571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71540f-978f-4767-b3a3-080041c6a4b8 service swift] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:08.824319 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:08.825158 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:08.825438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:08.825706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb admin admin] PATH_INFO: `/v3/projects/a965b3ef21e14d8787cc1b57b914f806` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:08.826919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a965b3ef21e14d8787cc1b57b914f806)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:08.828793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:08.876322 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a965b3ef21e14d8787cc1b57b914f806', 'request_id': 'req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:08.881670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a965b3ef21e14d8787cc1b57b914f806', 'request_id': 'req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:08.888677 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a965b3ef21e14d8787cc1b57b914f806', 'request_id': 'req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:08.901886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb admin admin] The token cache is being invalidate because project a965b3ef21e14d8787cc1b57b914f806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:12:08.902175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:08.902833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-bf7ac55e-0a6b-4dec-bc97-7571aaa3a7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:08.904506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1166/2347] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:12:08 2021] DELETE /identity/v3/projects/a965b3ef21e14d8787cc1b57b914f806 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:12:08.910108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f7c8b-78e9-4db2-9ed6-00e18e7beccb None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:08.910424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f7c8b-78e9-4db2-9ed6-00e18e7beccb None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:08.910706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f7c8b-78e9-4db2-9ed6-00e18e7beccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:08.957312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-bb6f7c8b-78e9-4db2-9ed6-00e18e7beccb None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:08.958547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-bb6f7c8b-78e9-4db2-9ed6-00e18e7beccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:09.018284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1182/2348] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:12:09.026909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923103e4-776f-42cb-aa8f-e16ff928395b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:09.027196 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923103e4-776f-42cb-aa8f-e16ff928395b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:09.027470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923103e4-776f-42cb-aa8f-e16ff928395b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:09.046573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-923103e4-776f-42cb-aa8f-e16ff928395b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:09.047795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-923103e4-776f-42cb-aa8f-e16ff928395b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:09.056727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1167/2349] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:12:09.060938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f7c8b-78e9-4db2-9ed6-00e18e7beccb None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:09.071590 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f7c8b-78e9-4db2-9ed6-00e18e7beccb None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:09.077242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3f3f4-ceba-4529-8da2-8db50617480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:09.078089 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3f3f4-ceba-4529-8da2-8db50617480d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:09.078509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3f3f4-ceba-4529-8da2-8db50617480d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:09.078885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3f3f4-ceba-4529-8da2-8db50617480d admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:09.079799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3f3f4-ceba-4529-8da2-8db50617480d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:12:09.080197 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3f3f4-ceba-4529-8da2-8db50617480d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:09.081989 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3f3f4-ceba-4529-8da2-8db50617480d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:09.094916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1183/2350] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:12:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:12:09.099153 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923103e4-776f-42cb-aa8f-e16ff928395b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:09.108144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923103e4-776f-42cb-aa8f-e16ff928395b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:09.112708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8ce56-4b57-4024-80c5-ef386414e543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:09.113342 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8ce56-4b57-4024-80c5-ef386414e543 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:09.113620 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8ce56-4b57-4024-80c5-ef386414e543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:09.113893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8ce56-4b57-4024-80c5-ef386414e543 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:09.114628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8ce56-4b57-4024-80c5-ef386414e543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:09.116505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8ce56-4b57-4024-80c5-ef386414e543 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:09.141270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1168/2351] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:12:09 2021] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:12:09.145279 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3f3f4-ceba-4529-8da2-8db50617480d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:09.155972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3f3f4-ceba-4529-8da2-8db50617480d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:09.218337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cae3f6-ab82-450c-98d8-f68a488dfe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:09.219027 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cae3f6-ab82-450c-98d8-f68a488dfe70 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:09.219306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cae3f6-ab82-450c-98d8-f68a488dfe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:09.219577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cae3f6-ab82-450c-98d8-f68a488dfe70 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:09.220290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cae3f6-ab82-450c-98d8-f68a488dfe70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:09.222191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cae3f6-ab82-450c-98d8-f68a488dfe70 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:09.248771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1184/2352] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:12:09 2021] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:12:09.249965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8ce56-4b57-4024-80c5-ef386414e543 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:09.261898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8ce56-4b57-4024-80c5-ef386414e543 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:09.266890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a370a-83f3-4561-84ec-482f433d518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:09.267644 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a370a-83f3-4561-84ec-482f433d518a admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:09.268019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a370a-83f3-4561-84ec-482f433d518a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:09.268419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a370a-83f3-4561-84ec-482f433d518a admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:09.269247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a370a-83f3-4561-84ec-482f433d518a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:09.270977 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a370a-83f3-4561-84ec-482f433d518a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:09.282624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1169/2353] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:12:09 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:12:09.286592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cae3f6-ab82-450c-98d8-f68a488dfe70 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:09.297330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cae3f6-ab82-450c-98d8-f68a488dfe70 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:09.301948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3206248-c666-4496-b673-5bbd663d8cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:09.302630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3206248-c666-4496-b673-5bbd663d8cff admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:09.302916 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3206248-c666-4496-b673-5bbd663d8cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:09.303191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3206248-c666-4496-b673-5bbd663d8cff admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:09.303928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3206248-c666-4496-b673-5bbd663d8cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:09.306095 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3206248-c666-4496-b673-5bbd663d8cff admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:09.315704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1185/2354] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:12:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:12:09.319730 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a370a-83f3-4561-84ec-482f433d518a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:09.329326 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a370a-83f3-4561-84ec-482f433d518a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:09.333932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d34438-13ee-4574-8237-a8eb65d2b06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:09.334826 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d34438-13ee-4574-8237-a8eb65d2b06f admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:09.335106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d34438-13ee-4574-8237-a8eb65d2b06f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:09.335568 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d34438-13ee-4574-8237-a8eb65d2b06f admin admin] PATH_INFO: `/v3/projects/c20cecde252949ed94b9e3dace954c5a/users/c0167b4c00764464ab1f7e06eceb8f30/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:09.352063 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d34438-13ee-4574-8237-a8eb65d2b06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20cecde252949ed94b9e3dace954c5a, user_id=c0167b4c00764464ab1f7e06eceb8f30, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:09.354819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d34438-13ee-4574-8237-a8eb65d2b06f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:09.368854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1170/2355] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:12:09 2021] PUT /identity/v3/projects/c20cecde252949ed94b9e3dace954c5a/users/c0167b4c00764464ab1f7e06eceb8f30/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:12:09.379677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba130e6-0b6e-4950-a098-7caf547379dd None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:09.379972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba130e6-0b6e-4950-a098-7caf547379dd None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:09.380254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba130e6-0b6e-4950-a098-7caf547379dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:09.406782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-6ba130e6-0b6e-4950-a098-7caf547379dd None None] MFA Rules not processed for user `c0167b4c00764464ab1f7e06eceb8f30`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:09.408010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6ba130e6-0b6e-4950-a098-7caf547379dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:09.472472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1186/2356] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:09 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:12:09.483954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d34438-13ee-4574-8237-a8eb65d2b06f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:09.485652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b0d34438-13ee-4574-8237-a8eb65d2b06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:09.562347 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d34438-13ee-4574-8237-a8eb65d2b06f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:09.566282 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a378633-99bd-4230-bf84-c13ad4119d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:09.566959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a378633-99bd-4230-bf84-c13ad4119d22 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:09.567293 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a378633-99bd-4230-bf84-c13ad4119d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:09.567597 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a378633-99bd-4230-bf84-c13ad4119d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:09.576951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a378633-99bd-4230-bf84-c13ad4119d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:09.578413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a378633-99bd-4230-bf84-c13ad4119d22 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:09.587625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1171/2357] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:12:09 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:12:12.120814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba130e6-0b6e-4950-a098-7caf547379dd None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:12.122228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6ba130e6-0b6e-4950-a098-7caf547379dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:12.215386 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba130e6-0b6e-4950-a098-7caf547379dd None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:12.220754 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab5f91-5067-435c-861a-2a34a1721140 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cebb33ff7c4e40a06b3c7f1a40823d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:12.221399 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5f91-5067-435c-861a-2a34a1721140 service placement] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:12.221685 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5f91-5067-435c-861a-2a34a1721140 service placement] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:12.221967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5f91-5067-435c-861a-2a34a1721140 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:12.223764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-26ab5f91-5067-435c-861a-2a34a1721140 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:12.235635 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab5f91-5067-435c-861a-2a34a1721140 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:12.237196 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab5f91-5067-435c-861a-2a34a1721140 service placement] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:12.247897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1187/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:12:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:12:29.429610 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2febf-ff06-4b5d-94f6-7eba51f468c0 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:29.430825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2febf-ff06-4b5d-94f6-7eba51f468c0 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:29.430825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2febf-ff06-4b5d-94f6-7eba51f468c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:29.459463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-8ce2febf-ff06-4b5d-94f6-7eba51f468c0 None None] MFA Rules not processed for user `7b9f193140654d6b9e2efbae04524b57`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:29.459463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8ce2febf-ff06-4b5d-94f6-7eba51f468c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:29.487892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab5f91-5067-435c-861a-2a34a1721140 service placement] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:29.489332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-26ab5f91-5067-435c-861a-2a34a1721140 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:29.549168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1172/2359] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:29 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:12:29.591750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab5f91-5067-435c-861a-2a34a1721140 service placement] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:29.598116 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56667c65-1139-45e1-8bd1-32e3bb8ff64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:29.599450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56667c65-1139-45e1-8bd1-32e3bb8ff64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:29.600025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56667c65-1139-45e1-8bd1-32e3bb8ff64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:29.600535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56667c65-1139-45e1-8bd1-32e3bb8ff64c admin admin] PATH_INFO: `/v3/users/d5ff623eda804e5980eee894d43cdc2e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:29.602777 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56667c65-1139-45e1-8bd1-32e3bb8ff64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ff623eda804e5980eee894d43cdc2e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:29.605659 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56667c65-1139-45e1-8bd1-32e3bb8ff64c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:29.692440 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-56667c65-1139-45e1-8bd1-32e3bb8ff64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ff623eda804e5980eee894d43cdc2e'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:29.693364 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-56667c65-1139-45e1-8bd1-32e3bb8ff64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ff623eda804e5980eee894d43cdc2e'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:29.702804 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-56667c65-1139-45e1-8bd1-32e3bb8ff64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ff623eda804e5980eee894d43cdc2e'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:29.703541 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-56667c65-1139-45e1-8bd1-32e3bb8ff64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ff623eda804e5980eee894d43cdc2e'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:29.721265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-56667c65-1139-45e1-8bd1-32e3bb8ff64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ff623eda804e5980eee894d43cdc2e'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:29.751189 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1188/2360] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:12:29 2021] DELETE /identity/v3/users/d5ff623eda804e5980eee894d43cdc2e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:12:29.965018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2febf-ff06-4b5d-94f6-7eba51f468c0 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:29.978570 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2febf-ff06-4b5d-94f6-7eba51f468c0 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:30.047001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:30.047866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:30.048146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:30.048423 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2 admin admin] PATH_INFO: `/v3/projects/f142a63d748e48d08bff8bfeeb533566` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:30.049657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f142a63d748e48d08bff8bfeeb533566)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:30.051589 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:30.109217 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f142a63d748e48d08bff8bfeeb533566', 'request_id': 'req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:30.119827 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f142a63d748e48d08bff8bfeeb533566', 'request_id': 'req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:30.128849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f142a63d748e48d08bff8bfeeb533566', 'request_id': 'req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:30.146074 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2 admin admin] The token cache is being invalidate because project f142a63d748e48d08bff8bfeeb533566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:12:30.146503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:30.147906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c55d9ed0-0a7a-4575-8d4b-56f947bf6af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:30.150421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1173/2361] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:12:29 2021] DELETE /identity/v3/projects/f142a63d748e48d08bff8bfeeb533566 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:12:30.156954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0811bfb-70c4-481c-ab50-73a236589e52 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:30.157644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0811bfb-70c4-481c-ab50-73a236589e52 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:30.158223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0811bfb-70c4-481c-ab50-73a236589e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:30.182002 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-f0811bfb-70c4-481c-ab50-73a236589e52 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:30.183480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f0811bfb-70c4-481c-ab50-73a236589e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:30.269240 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1189/2362] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:12:30.278171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34907fc7-c1c5-471c-87de-585bd964585a None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:30.278526 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34907fc7-c1c5-471c-87de-585bd964585a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:30.278808 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34907fc7-c1c5-471c-87de-585bd964585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:30.301365 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-34907fc7-c1c5-471c-87de-585bd964585a None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:30.302647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-34907fc7-c1c5-471c-87de-585bd964585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:30.311406 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1174/2363] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:12:30.316110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0811bfb-70c4-481c-ab50-73a236589e52 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:30.327266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0811bfb-70c4-481c-ab50-73a236589e52 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:30.331925 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b1723-6750-4a66-924b-d2269a55446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:30.332679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b1723-6750-4a66-924b-d2269a55446f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:30.332948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b1723-6750-4a66-924b-d2269a55446f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:30.333224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b1723-6750-4a66-924b-d2269a55446f admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:30.333970 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b1723-6750-4a66-924b-d2269a55446f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:12:30.334262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b1723-6750-4a66-924b-d2269a55446f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:30.335892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b1723-6750-4a66-924b-d2269a55446f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:30.354173 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1190/2364] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:12:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:12:30.358118 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34907fc7-c1c5-471c-87de-585bd964585a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:30.368639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34907fc7-c1c5-471c-87de-585bd964585a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:30.374099 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5ae35-c19e-4cd4-93b7-9d4f6497755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:30.374876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5ae35-c19e-4cd4-93b7-9d4f6497755f admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:30.375256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5ae35-c19e-4cd4-93b7-9d4f6497755f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:30.375637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5ae35-c19e-4cd4-93b7-9d4f6497755f admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:30.377906 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5ae35-c19e-4cd4-93b7-9d4f6497755f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:30.379925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5ae35-c19e-4cd4-93b7-9d4f6497755f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:30.414590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1175/2365] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:12:30 2021] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:12:30.418506 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b1723-6750-4a66-924b-d2269a55446f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:30.428575 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b1723-6750-4a66-924b-d2269a55446f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:30.488282 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca87c1-4e48-4755-8567-4557c3f6dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:30.489148 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca87c1-4e48-4755-8567-4557c3f6dd49 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:30.489245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca87c1-4e48-4755-8567-4557c3f6dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:30.489499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca87c1-4e48-4755-8567-4557c3f6dd49 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:30.490210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca87c1-4e48-4755-8567-4557c3f6dd49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:30.492902 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca87c1-4e48-4755-8567-4557c3f6dd49 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:30.516347 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1191/2366] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:12:30 2021] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:12:30.521341 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5ae35-c19e-4cd4-93b7-9d4f6497755f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:30.532794 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5ae35-c19e-4cd4-93b7-9d4f6497755f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:30.537650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ca382-43c8-47ea-9c2c-33626b17c4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:30.538448 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ca382-43c8-47ea-9c2c-33626b17c4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:30.538826 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ca382-43c8-47ea-9c2c-33626b17c4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:30.539256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ca382-43c8-47ea-9c2c-33626b17c4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:30.540078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ca382-43c8-47ea-9c2c-33626b17c4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:30.541782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ca382-43c8-47ea-9c2c-33626b17c4a6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:30.558711 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1176/2367] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:12:30 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:12:30.562865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca87c1-4e48-4755-8567-4557c3f6dd49 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:30.577953 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca87c1-4e48-4755-8567-4557c3f6dd49 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:30.583037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8386c9-21ef-4324-bfd9-f471da09bfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:30.583713 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8386c9-21ef-4324-bfd9-f471da09bfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:30.583997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8386c9-21ef-4324-bfd9-f471da09bfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:30.584268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8386c9-21ef-4324-bfd9-f471da09bfc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:30.585185 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8386c9-21ef-4324-bfd9-f471da09bfc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:30.588084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8386c9-21ef-4324-bfd9-f471da09bfc5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:30.600865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1192/2368] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:12:30 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:12:30.605752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ca382-43c8-47ea-9c2c-33626b17c4a6 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:30.615578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ca382-43c8-47ea-9c2c-33626b17c4a6 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:30.620582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db96893-b0ae-4cd4-ba43-216f3b311ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:30.621547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db96893-b0ae-4cd4-ba43-216f3b311ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:30.621910 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db96893-b0ae-4cd4-ba43-216f3b311ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:30.622087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db96893-b0ae-4cd4-ba43-216f3b311ba8 admin admin] PATH_INFO: `/v3/projects/e237e82cdcf24c93b91e0c1799f78928/users/e10d73a08d6e43e79df2c2e1d3161b7e/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:30.638590 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db96893-b0ae-4cd4-ba43-216f3b311ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e237e82cdcf24c93b91e0c1799f78928, user_id=e10d73a08d6e43e79df2c2e1d3161b7e, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:30.641261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db96893-b0ae-4cd4-ba43-216f3b311ba8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:30.654542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1177/2369] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:12:30 2021] PUT /identity/v3/projects/e237e82cdcf24c93b91e0c1799f78928/users/e10d73a08d6e43e79df2c2e1d3161b7e/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:12:30.659805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbd5f4-c5a9-45e0-ac97-dd5f7dd93aef None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:30.660104 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbd5f4-c5a9-45e0-ac97-dd5f7dd93aef None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:30.660382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbd5f4-c5a9-45e0-ac97-dd5f7dd93aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:30.678015 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-5cdbd5f4-c5a9-45e0-ac97-dd5f7dd93aef None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:30.679261 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5cdbd5f4-c5a9-45e0-ac97-dd5f7dd93aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:30.741627 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1193/2370] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:12:30.752034 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db96893-b0ae-4cd4-ba43-216f3b311ba8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:30.753738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4db96893-b0ae-4cd4-ba43-216f3b311ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:30.811738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db96893-b0ae-4cd4-ba43-216f3b311ba8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:30.815486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf66251-d376-4ae5-92d1-1245cd750164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:30.816134 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66251-d376-4ae5-92d1-1245cd750164 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:30.816418 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66251-d376-4ae5-92d1-1245cd750164 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:30.816696 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66251-d376-4ae5-92d1-1245cd750164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:30.828239 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf66251-d376-4ae5-92d1-1245cd750164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:30.829685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf66251-d376-4ae5-92d1-1245cd750164 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:30.840335 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1178/2371] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:12:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:12:37.772109 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a5e98-829d-47d2-b557-dee66a593f0a None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:37.772617 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a5e98-829d-47d2-b557-dee66a593f0a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:37.772848 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a5e98-829d-47d2-b557-dee66a593f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:37.803810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-362a5e98-829d-47d2-b557-dee66a593f0a None None] MFA Rules not processed for user `e10d73a08d6e43e79df2c2e1d3161b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:37.806026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-362a5e98-829d-47d2-b557-dee66a593f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:37.881062 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1194/2372] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:37 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:12:37.894890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf66251-d376-4ae5-92d1-1245cd750164 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:37.896877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-daf66251-d376-4ae5-92d1-1245cd750164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:38.005289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf66251-d376-4ae5-92d1-1245cd750164 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:38.012299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31f09d-5983-42c1-a4c3-7d957fd18d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:38.013035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31f09d-5983-42c1-a4c3-7d957fd18d1a service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:38.013334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31f09d-5983-42c1-a4c3-7d957fd18d1a service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:38.013694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31f09d-5983-42c1-a4c3-7d957fd18d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:38.023398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31f09d-5983-42c1-a4c3-7d957fd18d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:38.025622 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31f09d-5983-42c1-a4c3-7d957fd18d1a service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:38.035432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1179/2373] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:12:37 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:12:40.582421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb113da-0b1a-435e-9c00-c250b0df3388 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:40.585194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb113da-0b1a-435e-9c00-c250b0df3388 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:40.587233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb113da-0b1a-435e-9c00-c250b0df3388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:40.649333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-8bb113da-0b1a-435e-9c00-c250b0df3388 None None] MFA Rules not processed for user `e10d73a08d6e43e79df2c2e1d3161b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:40.650893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-8bb113da-0b1a-435e-9c00-c250b0df3388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:40.660356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1195/2374] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:40 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:12:42.255450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31f09d-5983-42c1-a4c3-7d957fd18d1a service nova] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:42.256787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-dd31f09d-5983-42c1-a4c3-7d957fd18d1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:42.281274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31f09d-5983-42c1-a4c3-7d957fd18d1a service nova] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:42.286256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78045747-5d6c-4525-9e7a-9640a2d808bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:42.287195 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78045747-5d6c-4525-9e7a-9640a2d808bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:42.287498 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78045747-5d6c-4525-9e7a-9640a2d808bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:42.287769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78045747-5d6c-4525-9e7a-9640a2d808bd admin admin] PATH_INFO: `/v3/users/59d2b98f1809405ab307a035062400c2` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:42.289139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78045747-5d6c-4525-9e7a-9640a2d808bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d2b98f1809405ab307a035062400c2)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:42.291075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78045747-5d6c-4525-9e7a-9640a2d808bd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:42.341701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-78045747-5d6c-4525-9e7a-9640a2d808bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d2b98f1809405ab307a035062400c2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:42.348368 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-78045747-5d6c-4525-9e7a-9640a2d808bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d2b98f1809405ab307a035062400c2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:42.349028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-78045747-5d6c-4525-9e7a-9640a2d808bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d2b98f1809405ab307a035062400c2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:42.349674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-78045747-5d6c-4525-9e7a-9640a2d808bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d2b98f1809405ab307a035062400c2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:42.362479 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-78045747-5d6c-4525-9e7a-9640a2d808bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d2b98f1809405ab307a035062400c2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:42.384717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1180/2375] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:12:42 2021] DELETE /identity/v3/users/59d2b98f1809405ab307a035062400c2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:12:42.580561 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb113da-0b1a-435e-9c00-c250b0df3388 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:42.592631 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb113da-0b1a-435e-9c00-c250b0df3388 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:42.659545 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ddd62-bab9-4e32-9be1-df0b1738ebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:42.660526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ddd62-bab9-4e32-9be1-df0b1738ebeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:42.660911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ddd62-bab9-4e32-9be1-df0b1738ebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:42.661430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ddd62-bab9-4e32-9be1-df0b1738ebeb admin admin] PATH_INFO: `/v3/projects/f6f062a4353046c9a44957550c394c9d` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:42.662790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ddd62-bab9-4e32-9be1-df0b1738ebeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f062a4353046c9a44957550c394c9d)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:42.665441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ddd62-bab9-4e32-9be1-df0b1738ebeb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:42.719660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-444ddd62-bab9-4e32-9be1-df0b1738ebeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f062a4353046c9a44957550c394c9d', 'request_id': 'req-444ddd62-bab9-4e32-9be1-df0b1738ebeb'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:42.726060 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-444ddd62-bab9-4e32-9be1-df0b1738ebeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f062a4353046c9a44957550c394c9d', 'request_id': 'req-444ddd62-bab9-4e32-9be1-df0b1738ebeb'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:42.735934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-444ddd62-bab9-4e32-9be1-df0b1738ebeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f062a4353046c9a44957550c394c9d', 'request_id': 'req-444ddd62-bab9-4e32-9be1-df0b1738ebeb'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:42.748284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-444ddd62-bab9-4e32-9be1-df0b1738ebeb admin admin] The token cache is being invalidate because project f6f062a4353046c9a44957550c394c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:12:42.748284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-444ddd62-bab9-4e32-9be1-df0b1738ebeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:42.748895 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-444ddd62-bab9-4e32-9be1-df0b1738ebeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:42.750795 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1196/2376] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:12:42 2021] DELETE /identity/v3/projects/f6f062a4353046c9a44957550c394c9d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:12:42.756989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4264377-5745-4a8b-b7bd-0bf5aa26b2d5 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:42.757274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4264377-5745-4a8b-b7bd-0bf5aa26b2d5 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:42.758063 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4264377-5745-4a8b-b7bd-0bf5aa26b2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:42.777625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c4264377-5745-4a8b-b7bd-0bf5aa26b2d5 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:42.778970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c4264377-5745-4a8b-b7bd-0bf5aa26b2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:42.847150 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1181/2377] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:12:42.856007 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33093dc3-75f2-4e42-bda7-45578e5a1f94 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:42.856403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33093dc3-75f2-4e42-bda7-45578e5a1f94 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:42.856754 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33093dc3-75f2-4e42-bda7-45578e5a1f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:42.884373 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-33093dc3-75f2-4e42-bda7-45578e5a1f94 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:42.885830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-33093dc3-75f2-4e42-bda7-45578e5a1f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:42.893818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1197/2378] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:12:42.898785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4264377-5745-4a8b-b7bd-0bf5aa26b2d5 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:42.908283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4264377-5745-4a8b-b7bd-0bf5aa26b2d5 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:42.913113 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386d007-2182-44d5-b45d-ba175c173602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:42.913828 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386d007-2182-44d5-b45d-ba175c173602 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:42.914112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386d007-2182-44d5-b45d-ba175c173602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:42.914416 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386d007-2182-44d5-b45d-ba175c173602 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:42.915212 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386d007-2182-44d5-b45d-ba175c173602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:12:42.915525 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386d007-2182-44d5-b45d-ba175c173602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:42.917186 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386d007-2182-44d5-b45d-ba175c173602 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:42.929355 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1182/2379] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:12:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:12:42.933722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33093dc3-75f2-4e42-bda7-45578e5a1f94 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:42.944047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33093dc3-75f2-4e42-bda7-45578e5a1f94 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:42.950251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04b10-fd3b-48ce-b693-3b0e97275bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:42.954322 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04b10-fd3b-48ce-b693-3b0e97275bfa admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:42.954889 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04b10-fd3b-48ce-b693-3b0e97275bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:42.955336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04b10-fd3b-48ce-b693-3b0e97275bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:42.956287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f04b10-fd3b-48ce-b693-3b0e97275bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:42.958435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f04b10-fd3b-48ce-b693-3b0e97275bfa admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:42.986413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1198/2380] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:12:42 2021] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:12:42.990715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386d007-2182-44d5-b45d-ba175c173602 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:43.002814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386d007-2182-44d5-b45d-ba175c173602 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:43.068579 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1e872-e000-4180-bf17-df9e7676d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:43.069643 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1e872-e000-4180-bf17-df9e7676d0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:43.069643 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1e872-e000-4180-bf17-df9e7676d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:43.069920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1e872-e000-4180-bf17-df9e7676d0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:43.071178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1e872-e000-4180-bf17-df9e7676d0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:43.073139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1e872-e000-4180-bf17-df9e7676d0a1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:43.097482 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1183/2381] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:12:42 2021] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:12:43.101461 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04b10-fd3b-48ce-b693-3b0e97275bfa admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:43.119294 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04b10-fd3b-48ce-b693-3b0e97275bfa admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:43.128781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e02f5-0182-4b24-a275-91ddf93762f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:43.129657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e02f5-0182-4b24-a275-91ddf93762f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:43.129965 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e02f5-0182-4b24-a275-91ddf93762f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:43.130241 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e02f5-0182-4b24-a275-91ddf93762f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:43.132086 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e02f5-0182-4b24-a275-91ddf93762f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:43.134588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e02f5-0182-4b24-a275-91ddf93762f5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:43.145667 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1199/2382] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:12:43 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:12:43.150016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1e872-e000-4180-bf17-df9e7676d0a1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:43.161281 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1e872-e000-4180-bf17-df9e7676d0a1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:43.166723 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9c7b7-65de-4b45-8a04-6d20e3518b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:43.167606 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9c7b7-65de-4b45-8a04-6d20e3518b2e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:43.167962 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9c7b7-65de-4b45-8a04-6d20e3518b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:43.168294 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9c7b7-65de-4b45-8a04-6d20e3518b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:43.169044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9c7b7-65de-4b45-8a04-6d20e3518b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:43.172161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9c7b7-65de-4b45-8a04-6d20e3518b2e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:43.186428 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1184/2383] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:12:43 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:12:43.188004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e02f5-0182-4b24-a275-91ddf93762f5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:43.202478 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e02f5-0182-4b24-a275-91ddf93762f5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:43.208328 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f4b0f-d2f7-484f-b7f4-2d9a707babe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:43.209223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f4b0f-d2f7-484f-b7f4-2d9a707babe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:43.209509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f4b0f-d2f7-484f-b7f4-2d9a707babe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:43.209788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f4b0f-d2f7-484f-b7f4-2d9a707babe8 admin admin] PATH_INFO: `/v3/projects/df09d26df7c047b3a6e1a279bf397cfd/users/ec06b703ab004498b4d00c6944e4d844/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:43.224752 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f4b0f-d2f7-484f-b7f4-2d9a707babe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df09d26df7c047b3a6e1a279bf397cfd, user_id=ec06b703ab004498b4d00c6944e4d844, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:43.227839 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f4b0f-d2f7-484f-b7f4-2d9a707babe8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:43.244324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1200/2384] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:12:43 2021] PUT /identity/v3/projects/df09d26df7c047b3a6e1a279bf397cfd/users/ec06b703ab004498b4d00c6944e4d844/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:12:43.254887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639273ab-639f-4119-8181-ec57799f6294 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:43.255196 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639273ab-639f-4119-8181-ec57799f6294 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:43.255555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639273ab-639f-4119-8181-ec57799f6294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:43.286403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-639273ab-639f-4119-8181-ec57799f6294 None None] MFA Rules not processed for user `ec06b703ab004498b4d00c6944e4d844`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:43.291732 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-639273ab-639f-4119-8181-ec57799f6294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:43.366507 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1185/2385] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:43 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:12:43.368979 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f4b0f-d2f7-484f-b7f4-2d9a707babe8 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:43.434807 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f4b0f-d2f7-484f-b7f4-2d9a707babe8 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:43.439552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb30c5-2986-410d-892e-bc7f06eb7e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:43.440237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb30c5-2986-410d-892e-bc7f06eb7e6b admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:43.440576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb30c5-2986-410d-892e-bc7f06eb7e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:43.440876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb30c5-2986-410d-892e-bc7f06eb7e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:43.441627 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb30c5-2986-410d-892e-bc7f06eb7e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:43.443662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb30c5-2986-410d-892e-bc7f06eb7e6b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:43.472526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1201/2386] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:12:43 2021] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:12:43.477725 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639273ab-639f-4119-8181-ec57799f6294 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:43.489180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639273ab-639f-4119-8181-ec57799f6294 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:43.570433 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef414628-25ba-40ac-9a5c-5db84214917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:43.572671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef414628-25ba-40ac-9a5c-5db84214917a admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:43.573043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef414628-25ba-40ac-9a5c-5db84214917a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:43.573385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef414628-25ba-40ac-9a5c-5db84214917a admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:43.574198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef414628-25ba-40ac-9a5c-5db84214917a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:43.578127 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef414628-25ba-40ac-9a5c-5db84214917a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:43.604412 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1186/2387] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:12:43 2021] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:12:43.608381 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb30c5-2986-410d-892e-bc7f06eb7e6b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:43.619673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb30c5-2986-410d-892e-bc7f06eb7e6b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:43.626679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b2c87-1f37-4109-a1dc-ffd4e77d4c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:43.628364 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2c87-1f37-4109-a1dc-ffd4e77d4c68 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:43.628991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2c87-1f37-4109-a1dc-ffd4e77d4c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:43.629472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2c87-1f37-4109-a1dc-ffd4e77d4c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:43.631147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b2c87-1f37-4109-a1dc-ffd4e77d4c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:43.633371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b2c87-1f37-4109-a1dc-ffd4e77d4c68 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:43.646466 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1202/2388] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:12:43 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:12:43.651346 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef414628-25ba-40ac-9a5c-5db84214917a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:43.666762 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef414628-25ba-40ac-9a5c-5db84214917a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:43.671603 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be647ac-82e0-4353-b980-7e3679d629c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:43.672490 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be647ac-82e0-4353-b980-7e3679d629c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:43.672771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be647ac-82e0-4353-b980-7e3679d629c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:43.673047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be647ac-82e0-4353-b980-7e3679d629c2 admin admin] PATH_INFO: `/v3/projects/9427d5aca80c4777812d1ef7c1d47112/users/3cc005e5a9f4418189a3975cb758aad0/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:43.693647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be647ac-82e0-4353-b980-7e3679d629c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9427d5aca80c4777812d1ef7c1d47112, user_id=3cc005e5a9f4418189a3975cb758aad0, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:43.696995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be647ac-82e0-4353-b980-7e3679d629c2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:43.719055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1187/2389] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:12:43 2021] PUT /identity/v3/projects/9427d5aca80c4777812d1ef7c1d47112/users/3cc005e5a9f4418189a3975cb758aad0/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:12:43.724437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b2c87-1f37-4109-a1dc-ffd4e77d4c68 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:43.736704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b2c87-1f37-4109-a1dc-ffd4e77d4c68 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:43.808569 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f6f16-1505-4bb9-8892-5d72e6dcbccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:43.809404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f6f16-1505-4bb9-8892-5d72e6dcbccb admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:43.809780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f6f16-1505-4bb9-8892-5d72e6dcbccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:43.810329 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f6f16-1505-4bb9-8892-5d72e6dcbccb admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:43.811323 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f6f16-1505-4bb9-8892-5d72e6dcbccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:43.813000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f6f16-1505-4bb9-8892-5d72e6dcbccb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:43.824721 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1203/2390] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:12:43 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:12:43.828871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be647ac-82e0-4353-b980-7e3679d629c2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:43.841413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be647ac-82e0-4353-b980-7e3679d629c2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:43.851796 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02224e60-90bc-4991-8ffa-5174bbda21b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:43.853120 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02224e60-90bc-4991-8ffa-5174bbda21b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:43.853957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02224e60-90bc-4991-8ffa-5174bbda21b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:43.853957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02224e60-90bc-4991-8ffa-5174bbda21b2 admin admin] PATH_INFO: `/v3/projects/9427d5aca80c4777812d1ef7c1d47112/users/3cc005e5a9f4418189a3975cb758aad0/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:43.860219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02224e60-90bc-4991-8ffa-5174bbda21b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9427d5aca80c4777812d1ef7c1d47112, user_id=3cc005e5a9f4418189a3975cb758aad0, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:43.863306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02224e60-90bc-4991-8ffa-5174bbda21b2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:43.876073 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1188/2391] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:12:43 2021] PUT /identity/v3/projects/9427d5aca80c4777812d1ef7c1d47112/users/3cc005e5a9f4418189a3975cb758aad0/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:12:43.886784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938e7a-7b86-4940-84d5-2e21a19d8434 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:43.886942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938e7a-7b86-4940-84d5-2e21a19d8434 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:43.887265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938e7a-7b86-4940-84d5-2e21a19d8434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:43.918888 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-38938e7a-7b86-4940-84d5-2e21a19d8434 None None] MFA Rules not processed for user `3cc005e5a9f4418189a3975cb758aad0`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:43.920338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-38938e7a-7b86-4940-84d5-2e21a19d8434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:44.048550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1204/2392] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:43 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:12:44.060047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02224e60-90bc-4991-8ffa-5174bbda21b2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:44.062286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-02224e60-90bc-4991-8ffa-5174bbda21b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:44.160524 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02224e60-90bc-4991-8ffa-5174bbda21b2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:44.165110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d71c2d-addb-44e0-be9d-4cb8072211f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:44.166124 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d71c2d-addb-44e0-be9d-4cb8072211f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:44.166124 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d71c2d-addb-44e0-be9d-4cb8072211f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:44.166434 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d71c2d-addb-44e0-be9d-4cb8072211f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:44.176960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d71c2d-addb-44e0-be9d-4cb8072211f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:44.178658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d71c2d-addb-44e0-be9d-4cb8072211f8 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:44.191006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1189/2393] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:12:44 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:12:44.307038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38938e7a-7b86-4940-84d5-2e21a19d8434 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:44.317583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38938e7a-7b86-4940-84d5-2e21a19d8434 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:44.326955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481d489-3ed6-4e9c-a5bb-82cc046d557f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:44.327823 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481d489-3ed6-4e9c-a5bb-82cc046d557f service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:44.328190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481d489-3ed6-4e9c-a5bb-82cc046d557f service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:44.328582 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481d489-3ed6-4e9c-a5bb-82cc046d557f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:44.386508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481d489-3ed6-4e9c-a5bb-82cc046d557f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:44.387961 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481d489-3ed6-4e9c-a5bb-82cc046d557f service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:44.396999 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1205/2394] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:12:44 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:12:58.768042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d71c2d-addb-44e0-be9d-4cb8072211f8 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:58.828550 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d71c2d-addb-44e0-be9d-4cb8072211f8 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:58.833103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:58.833950 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:58.834235 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:58.834542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] PATH_INFO: `/v3/users/ec06b703ab004498b4d00c6944e4d844` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:58.835735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec06b703ab004498b4d00c6944e4d844)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:58.838218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:58.883480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec06b703ab004498b4d00c6944e4d844'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:58.890561 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec06b703ab004498b4d00c6944e4d844'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:58.891289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec06b703ab004498b4d00c6944e4d844'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:58.891899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec06b703ab004498b4d00c6944e4d844'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:58.904226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec06b703ab004498b4d00c6944e4d844'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:58.917764 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1190/2395] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:12:58 2021] DELETE /identity/v3/users/ec06b703ab004498b4d00c6944e4d844 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:12:58.926269 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ec472-a929-46e3-9eac-7482a97d9a4b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:58.926269 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ec472-a929-46e3-9eac-7482a97d9a4b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:58.926269 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ec472-a929-46e3-9eac-7482a97d9a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:58.940354 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-1d9ec472-a929-46e3-9eac-7482a97d9a4b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:12:58.941526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1d9ec472-a929-46e3-9eac-7482a97d9a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:58.998716 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1206/2396] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:12:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:12:59.008505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:59.010565 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:59.065540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1c05e-d279-44da-b558-4ab3d0e9aac1 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:59.069158 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820a6ac-42a4-42b0-beb7-8b68e2f12b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:59.069793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820a6ac-42a4-42b0-beb7-8b68e2f12b57 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:59.070076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820a6ac-42a4-42b0-beb7-8b68e2f12b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:59.070352 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820a6ac-42a4-42b0-beb7-8b68e2f12b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:59.079866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820a6ac-42a4-42b0-beb7-8b68e2f12b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:59.081280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820a6ac-42a4-42b0-beb7-8b68e2f12b57 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:59.090977 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1191/2397] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:12:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:12:59.371827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ec472-a929-46e3-9eac-7482a97d9a4b None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:59.373404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1d9ec472-a929-46e3-9eac-7482a97d9a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:59.389436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ec472-a929-46e3-9eac-7482a97d9a4b None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:59.394949 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:59.395876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:59.396140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:59.396405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] PATH_INFO: `/v3/projects/df09d26df7c047b3a6e1a279bf397cfd` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:59.397929 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df09d26df7c047b3a6e1a279bf397cfd)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:59.400732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:59.450292 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df09d26df7c047b3a6e1a279bf397cfd', 'request_id': 'req-870b0b10-c937-46dd-8c7f-9561107c92e7'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:59.456205 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df09d26df7c047b3a6e1a279bf397cfd', 'request_id': 'req-870b0b10-c937-46dd-8c7f-9561107c92e7'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:59.464666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df09d26df7c047b3a6e1a279bf397cfd', 'request_id': 'req-870b0b10-c937-46dd-8c7f-9561107c92e7'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:59.475085 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] The token cache is being invalidate because project df09d26df7c047b3a6e1a279bf397cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:12:59.475371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:59.475994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:59.479967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1207/2398] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:12:59 2021] DELETE /identity/v3/projects/df09d26df7c047b3a6e1a279bf397cfd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:12:59.484251 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820a6ac-42a4-42b0-beb7-8b68e2f12b57 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:59.495502 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820a6ac-42a4-42b0-beb7-8b68e2f12b57 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:59.556749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2de8af-b144-4d8b-8b9d-b6a771e65e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:59.557601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de8af-b144-4d8b-8b9d-b6a771e65e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:59.557882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de8af-b144-4d8b-8b9d-b6a771e65e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:59.558155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de8af-b144-4d8b-8b9d-b6a771e65e64 admin admin] PATH_INFO: `/v3/users/3cc005e5a9f4418189a3975cb758aad0` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:59.559380 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2de8af-b144-4d8b-8b9d-b6a771e65e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc005e5a9f4418189a3975cb758aad0)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:59.561277 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2de8af-b144-4d8b-8b9d-b6a771e65e64 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:12:59.605891 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-da2de8af-b144-4d8b-8b9d-b6a771e65e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc005e5a9f4418189a3975cb758aad0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:59.612346 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-da2de8af-b144-4d8b-8b9d-b6a771e65e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc005e5a9f4418189a3975cb758aad0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:59.613004 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-da2de8af-b144-4d8b-8b9d-b6a771e65e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc005e5a9f4418189a3975cb758aad0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:59.613586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-da2de8af-b144-4d8b-8b9d-b6a771e65e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc005e5a9f4418189a3975cb758aad0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:59.624708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-da2de8af-b144-4d8b-8b9d-b6a771e65e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc005e5a9f4418189a3975cb758aad0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:12:59.636974 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1192/2399] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:12:59 2021] DELETE /identity/v3/users/3cc005e5a9f4418189a3975cb758aad0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:12:59.908369 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:12:59.909817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:12:59.929699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b0b10-c937-46dd-8c7f-9561107c92e7 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:12:59.986944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc2cd1-28de-4270-ae7c-1943549d1560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:12:59.987719 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc2cd1-28de-4270-ae7c-1943549d1560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:12:59.988004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc2cd1-28de-4270-ae7c-1943549d1560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:12:59.988284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc2cd1-28de-4270-ae7c-1943549d1560 admin admin] PATH_INFO: `/v3/projects/9427d5aca80c4777812d1ef7c1d47112` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:12:59.989495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc2cd1-28de-4270-ae7c-1943549d1560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9427d5aca80c4777812d1ef7c1d47112)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:12:59.991429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc2cd1-28de-4270-ae7c-1943549d1560 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.036995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bafc2cd1-28de-4270-ae7c-1943549d1560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9427d5aca80c4777812d1ef7c1d47112', 'request_id': 'req-bafc2cd1-28de-4270-ae7c-1943549d1560'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:00.042975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bafc2cd1-28de-4270-ae7c-1943549d1560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9427d5aca80c4777812d1ef7c1d47112', 'request_id': 'req-bafc2cd1-28de-4270-ae7c-1943549d1560'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:00.050092 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bafc2cd1-28de-4270-ae7c-1943549d1560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9427d5aca80c4777812d1ef7c1d47112', 'request_id': 'req-bafc2cd1-28de-4270-ae7c-1943549d1560'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:00.060497 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bafc2cd1-28de-4270-ae7c-1943549d1560 admin admin] The token cache is being invalidate because project 9427d5aca80c4777812d1ef7c1d47112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:00.060787 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bafc2cd1-28de-4270-ae7c-1943549d1560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:00.061982 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bafc2cd1-28de-4270-ae7c-1943549d1560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:00.063546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1208/2400] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:12:59 2021] DELETE /identity/v3/projects/9427d5aca80c4777812d1ef7c1d47112 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:13:00.069198 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfceaf-022d-45d5-9fa6-c78a9809910f None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.069685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfceaf-022d-45d5-9fa6-c78a9809910f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.069881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfceaf-022d-45d5-9fa6-c78a9809910f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.089193 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-bedfceaf-022d-45d5-9fa6-c78a9809910f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:00.090453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-bedfceaf-022d-45d5-9fa6-c78a9809910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:00.146685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1193/2401] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:13:00.156449 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cdc2a-86b7-495d-ade7-77eb7756cb01 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.156761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cdc2a-86b7-495d-ade7-77eb7756cb01 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.157040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cdc2a-86b7-495d-ade7-77eb7756cb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.175411 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2a6cdc2a-86b7-495d-ade7-77eb7756cb01 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:00.176608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2a6cdc2a-86b7-495d-ade7-77eb7756cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:00.184728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1209/2402] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:00.189122 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfceaf-022d-45d5-9fa6-c78a9809910f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:00.199435 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfceaf-022d-45d5-9fa6-c78a9809910f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:00.209449 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d0050-2ed2-44c9-9d38-893ba07a3bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:00.210120 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d0050-2ed2-44c9-9d38-893ba07a3bba admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.210435 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d0050-2ed2-44c9-9d38-893ba07a3bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.210716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d0050-2ed2-44c9-9d38-893ba07a3bba admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.211459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d0050-2ed2-44c9-9d38-893ba07a3bba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:13:00.212670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d0050-2ed2-44c9-9d38-893ba07a3bba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:00.214283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d0050-2ed2-44c9-9d38-893ba07a3bba admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.226299 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1194/2403] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:13:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:13:00.231290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cdc2a-86b7-495d-ade7-77eb7756cb01 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:00.240335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cdc2a-86b7-495d-ade7-77eb7756cb01 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:00.245531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268b67a-7eeb-409e-9f62-1e70eb8f73b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:00.246191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268b67a-7eeb-409e-9f62-1e70eb8f73b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.246501 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268b67a-7eeb-409e-9f62-1e70eb8f73b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.246773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268b67a-7eeb-409e-9f62-1e70eb8f73b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.247476 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268b67a-7eeb-409e-9f62-1e70eb8f73b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:00.249355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268b67a-7eeb-409e-9f62-1e70eb8f73b5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.273833 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1210/2404] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:00 2021] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:13:00.279062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d0050-2ed2-44c9-9d38-893ba07a3bba admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:00.288823 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d0050-2ed2-44c9-9d38-893ba07a3bba admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:00.343531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bcc8f-a432-4500-bb43-8da719a187cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:00.344194 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bcc8f-a432-4500-bb43-8da719a187cb admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.344481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bcc8f-a432-4500-bb43-8da719a187cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.344788 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bcc8f-a432-4500-bb43-8da719a187cb admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.345505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bcc8f-a432-4500-bb43-8da719a187cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:00.347586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bcc8f-a432-4500-bb43-8da719a187cb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.371599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1195/2405] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:13:00 2021] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:13:00.372766 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268b67a-7eeb-409e-9f62-1e70eb8f73b5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:00.382976 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268b67a-7eeb-409e-9f62-1e70eb8f73b5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:00.387976 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d523-a759-435c-b6b0-f87b8908a499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:00.388618 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d523-a759-435c-b6b0-f87b8908a499 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.388903 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d523-a759-435c-b6b0-f87b8908a499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.389174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d523-a759-435c-b6b0-f87b8908a499 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.390083 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872d523-a759-435c-b6b0-f87b8908a499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:00.391664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872d523-a759-435c-b6b0-f87b8908a499 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.402896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1211/2406] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:00.406787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bcc8f-a432-4500-bb43-8da719a187cb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:00.417138 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bcc8f-a432-4500-bb43-8da719a187cb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:00.421709 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc129-acd7-4b90-9969-e7f5e3421aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:00.422359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc129-acd7-4b90-9969-e7f5e3421aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.422665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc129-acd7-4b90-9969-e7f5e3421aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.422937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc129-acd7-4b90-9969-e7f5e3421aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.423665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bc129-acd7-4b90-9969-e7f5e3421aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:00.425243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bc129-acd7-4b90-9969-e7f5e3421aa2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.438434 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1196/2407] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:13:00.439810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d523-a759-435c-b6b0-f87b8908a499 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:00.449932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d523-a759-435c-b6b0-f87b8908a499 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:00.454588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094920f0-8c89-4d8c-b6fa-facf3979d19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:00.455391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094920f0-8c89-4d8c-b6fa-facf3979d19e admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.455663 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094920f0-8c89-4d8c-b6fa-facf3979d19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.455932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094920f0-8c89-4d8c-b6fa-facf3979d19e admin admin] PATH_INFO: `/v3/projects/ba7da0bed18845cfa808b614cd67c024/users/2f2359c1cde84cb98e380d8d04062d70/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.471619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094920f0-8c89-4d8c-b6fa-facf3979d19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7da0bed18845cfa808b614cd67c024, user_id=2f2359c1cde84cb98e380d8d04062d70, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:00.474384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094920f0-8c89-4d8c-b6fa-facf3979d19e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.489094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1212/2408] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:00 2021] PUT /identity/v3/projects/ba7da0bed18845cfa808b614cd67c024/users/2f2359c1cde84cb98e380d8d04062d70/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:00.500064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaf367-dca9-4fc0-a3ed-c9a7acd05471 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.500355 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaf367-dca9-4fc0-a3ed-c9a7acd05471 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.500636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaf367-dca9-4fc0-a3ed-c9a7acd05471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.528103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-5aaaf367-dca9-4fc0-a3ed-c9a7acd05471 None None] MFA Rules not processed for user `2f2359c1cde84cb98e380d8d04062d70`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:00.529303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5aaaf367-dca9-4fc0-a3ed-c9a7acd05471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:00.593802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1197/2409] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:00 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:00.598136 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094920f0-8c89-4d8c-b6fa-facf3979d19e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:00.657409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094920f0-8c89-4d8c-b6fa-facf3979d19e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:00.662033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52bcb2-a935-4b64-9118-c3f8f1a1c322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:00.662714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52bcb2-a935-4b64-9118-c3f8f1a1c322 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.662997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52bcb2-a935-4b64-9118-c3f8f1a1c322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.663271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52bcb2-a935-4b64-9118-c3f8f1a1c322 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.663967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52bcb2-a935-4b64-9118-c3f8f1a1c322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:00.666436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52bcb2-a935-4b64-9118-c3f8f1a1c322 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.695516 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1213/2410] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:00 2021] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:00.696934 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaaf367-dca9-4fc0-a3ed-c9a7acd05471 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:00.707487 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaaf367-dca9-4fc0-a3ed-c9a7acd05471 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:00.761861 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234a88-352b-4e0c-80ee-bfd1275f88fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:00.762475 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234a88-352b-4e0c-80ee-bfd1275f88fe admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.762761 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234a88-352b-4e0c-80ee-bfd1275f88fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.763038 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234a88-352b-4e0c-80ee-bfd1275f88fe admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.763733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0234a88-352b-4e0c-80ee-bfd1275f88fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:00.765650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0234a88-352b-4e0c-80ee-bfd1275f88fe admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.785329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1198/2411] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:13:00 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:13:00.789413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52bcb2-a935-4b64-9118-c3f8f1a1c322 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:00.799955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52bcb2-a935-4b64-9118-c3f8f1a1c322 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:00.804758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2f461-3f4d-4695-8770-c8325ff82d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:00.806127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2f461-3f4d-4695-8770-c8325ff82d5d admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.806451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2f461-3f4d-4695-8770-c8325ff82d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.806726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2f461-3f4d-4695-8770-c8325ff82d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.807455 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2f461-3f4d-4695-8770-c8325ff82d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:00.809027 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2f461-3f4d-4695-8770-c8325ff82d5d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.820396 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1214/2412] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:00.824391 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234a88-352b-4e0c-80ee-bfd1275f88fe admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:00.834178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234a88-352b-4e0c-80ee-bfd1275f88fe admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:00.839104 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809d5c0-a1e5-42cd-a249-74edead64a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:00.839971 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809d5c0-a1e5-42cd-a249-74edead64a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.840256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809d5c0-a1e5-42cd-a249-74edead64a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.840532 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809d5c0-a1e5-42cd-a249-74edead64a73 admin admin] PATH_INFO: `/v3/projects/1d9627a2d03a49aeadaa16e21f4839a5/users/f07d86c79b58489baab34127b0fb9d58/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.855853 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809d5c0-a1e5-42cd-a249-74edead64a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9627a2d03a49aeadaa16e21f4839a5, user_id=f07d86c79b58489baab34127b0fb9d58, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:00.858528 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809d5c0-a1e5-42cd-a249-74edead64a73 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.871769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1199/2413] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:00 2021] PUT /identity/v3/projects/1d9627a2d03a49aeadaa16e21f4839a5/users/f07d86c79b58489baab34127b0fb9d58/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:00.875614 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2f461-3f4d-4695-8770-c8325ff82d5d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:00.885161 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2f461-3f4d-4695-8770-c8325ff82d5d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:00.938442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a8323-08fc-4f38-a86c-b8de72c9ca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:00.939092 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a8323-08fc-4f38-a86c-b8de72c9ca33 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.939371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a8323-08fc-4f38-a86c-b8de72c9ca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.939644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a8323-08fc-4f38-a86c-b8de72c9ca33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.940361 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a8323-08fc-4f38-a86c-b8de72c9ca33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:00.941931 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a8323-08fc-4f38-a86c-b8de72c9ca33 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.951399 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1215/2414] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:00 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:00.955376 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809d5c0-a1e5-42cd-a249-74edead64a73 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:00.965896 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809d5c0-a1e5-42cd-a249-74edead64a73 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:00.970545 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2591e-2187-41e9-9880-d1678584fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:00.971413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2591e-2187-41e9-9880-d1678584fe34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.971688 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2591e-2187-41e9-9880-d1678584fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.971958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2591e-2187-41e9-9880-d1678584fe34 admin admin] PATH_INFO: `/v3/projects/1d9627a2d03a49aeadaa16e21f4839a5/users/f07d86c79b58489baab34127b0fb9d58/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:00.973911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2591e-2187-41e9-9880-d1678584fe34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9627a2d03a49aeadaa16e21f4839a5, user_id=f07d86c79b58489baab34127b0fb9d58, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:00.976548 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2591e-2187-41e9-9880-d1678584fe34 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:00.987704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1200/2415] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:00 2021] PUT /identity/v3/projects/1d9627a2d03a49aeadaa16e21f4839a5/users/f07d86c79b58489baab34127b0fb9d58/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:00.998684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76fa75-47d7-4068-a059-68490d87bc3c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:00.998971 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76fa75-47d7-4068-a059-68490d87bc3c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:00.999249 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76fa75-47d7-4068-a059-68490d87bc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:01.025074 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-3a76fa75-47d7-4068-a059-68490d87bc3c None None] MFA Rules not processed for user `f07d86c79b58489baab34127b0fb9d58`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:01.026273 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-3a76fa75-47d7-4068-a059-68490d87bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:01.090475 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1216/2416] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:00 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:01.100758 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2591e-2187-41e9-9880-d1678584fe34 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:01.103005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-72e2591e-2187-41e9-9880-d1678584fe34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:01.160069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2591e-2187-41e9-9880-d1678584fe34 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:01.163681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87ed39-1cb9-46ac-8714-6eb843abd343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:01.164304 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87ed39-1cb9-46ac-8714-6eb843abd343 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:01.164582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87ed39-1cb9-46ac-8714-6eb843abd343 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:01.165534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87ed39-1cb9-46ac-8714-6eb843abd343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:01.174242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87ed39-1cb9-46ac-8714-6eb843abd343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:01.175697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87ed39-1cb9-46ac-8714-6eb843abd343 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:01.184849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1201/2417] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:01 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:01.255432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76fa75-47d7-4068-a059-68490d87bc3c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:01.265072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76fa75-47d7-4068-a059-68490d87bc3c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:01.269008 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8cf19-5559-48e0-a922-cba844669ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:01.269655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8cf19-5559-48e0-a922-cba844669ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:01.269937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8cf19-5559-48e0-a922-cba844669ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:01.270213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8cf19-5559-48e0-a922-cba844669ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:01.325217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8cf19-5559-48e0-a922-cba844669ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:01.326587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8cf19-5559-48e0-a922-cba844669ed8 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:01.335235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1217/2418] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:01 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:04.033948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87ed39-1cb9-46ac-8714-6eb843abd343 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:04.104993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87ed39-1cb9-46ac-8714-6eb843abd343 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:04.113272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:04.114152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:04.114755 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:04.115070 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] PATH_INFO: `/v3/users/2f2359c1cde84cb98e380d8d04062d70` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:04.116708 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f2359c1cde84cb98e380d8d04062d70)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:04.119468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:04.172683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2359c1cde84cb98e380d8d04062d70'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.179651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2359c1cde84cb98e380d8d04062d70'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.180939 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2359c1cde84cb98e380d8d04062d70'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.181928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2359c1cde84cb98e380d8d04062d70'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.200581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2359c1cde84cb98e380d8d04062d70'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.215863 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1202/2419] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:13:04 2021] DELETE /identity/v3/users/2f2359c1cde84cb98e380d8d04062d70 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:04.220229 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afc300-41b9-46a3-8ef0-5c4a19c1cfde None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:04.220649 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afc300-41b9-46a3-8ef0-5c4a19c1cfde None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:04.220832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afc300-41b9-46a3-8ef0-5c4a19c1cfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:04.240592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-52afc300-41b9-46a3-8ef0-5c4a19c1cfde None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:04.245147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-52afc300-41b9-46a3-8ef0-5c4a19c1cfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:04.309810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1218/2420] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:04.319413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:04.321043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:04.381970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c0fd0-567f-47d8-9694-ce06409b2c4c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:04.386646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a45b41-69ca-40ad-8b8d-9fd459400250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:04.387359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a45b41-69ca-40ad-8b8d-9fd459400250 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:04.387710 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a45b41-69ca-40ad-8b8d-9fd459400250 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:04.388221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a45b41-69ca-40ad-8b8d-9fd459400250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:04.397976 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a45b41-69ca-40ad-8b8d-9fd459400250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:04.399686 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a45b41-69ca-40ad-8b8d-9fd459400250 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:04.409851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1203/2421] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:04.701774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afc300-41b9-46a3-8ef0-5c4a19c1cfde None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:04.703417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-52afc300-41b9-46a3-8ef0-5c4a19c1cfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:04.716952 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afc300-41b9-46a3-8ef0-5c4a19c1cfde None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:04.721736 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:04.722738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:04.723024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:04.723292 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] PATH_INFO: `/v3/projects/ba7da0bed18845cfa808b614cd67c024` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:04.724491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba7da0bed18845cfa808b614cd67c024)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:04.726418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:04.772517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7da0bed18845cfa808b614cd67c024', 'request_id': 'req-401a6ed6-62c7-44b0-8cb5-a9513d39246d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.779307 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7da0bed18845cfa808b614cd67c024', 'request_id': 'req-401a6ed6-62c7-44b0-8cb5-a9513d39246d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.786330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7da0bed18845cfa808b614cd67c024', 'request_id': 'req-401a6ed6-62c7-44b0-8cb5-a9513d39246d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.797792 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] The token cache is being invalidate because project ba7da0bed18845cfa808b614cd67c024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:04.798075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.798761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.800428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1219/2422] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:13:04 2021] DELETE /identity/v3/projects/ba7da0bed18845cfa808b614cd67c024 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:13:04.804394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a45b41-69ca-40ad-8b8d-9fd459400250 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:04.818744 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a45b41-69ca-40ad-8b8d-9fd459400250 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:04.874640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1360d-ec20-49b4-926f-d9486ceef6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:04.875496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1360d-ec20-49b4-926f-d9486ceef6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:04.875773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1360d-ec20-49b4-926f-d9486ceef6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:04.876046 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1360d-ec20-49b4-926f-d9486ceef6d2 admin admin] PATH_INFO: `/v3/users/f07d86c79b58489baab34127b0fb9d58` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:04.877221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1360d-ec20-49b4-926f-d9486ceef6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07d86c79b58489baab34127b0fb9d58)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:04.879142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1360d-ec20-49b4-926f-d9486ceef6d2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:04.910037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:04.911526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:04.924694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6ed6-62c7-44b0-8cb5-a9513d39246d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:04.926605 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-99c1360d-ec20-49b4-926f-d9486ceef6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07d86c79b58489baab34127b0fb9d58'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.929348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:04.930203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:04.930515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:04.930789 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] PATH_INFO: `/v3/users/c0167b4c00764464ab1f7e06eceb8f30` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:04.931976 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0167b4c00764464ab1f7e06eceb8f30)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:04.933381 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-99c1360d-ec20-49b4-926f-d9486ceef6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07d86c79b58489baab34127b0fb9d58'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.933996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:04.934105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-99c1360d-ec20-49b4-926f-d9486ceef6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07d86c79b58489baab34127b0fb9d58'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.934659 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-99c1360d-ec20-49b4-926f-d9486ceef6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07d86c79b58489baab34127b0fb9d58'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.945900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-99c1360d-ec20-49b4-926f-d9486ceef6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07d86c79b58489baab34127b0fb9d58'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.959882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1204/2423] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:13:04 2021] DELETE /identity/v3/users/f07d86c79b58489baab34127b0fb9d58 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:04.981467 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0167b4c00764464ab1f7e06eceb8f30'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.982144 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0167b4c00764464ab1f7e06eceb8f30'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.989009 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0167b4c00764464ab1f7e06eceb8f30'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:04.989668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0167b4c00764464ab1f7e06eceb8f30'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:05.001638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0167b4c00764464ab1f7e06eceb8f30'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:05.014216 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1220/2424] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:13:04 2021] DELETE /identity/v3/users/c0167b4c00764464ab1f7e06eceb8f30 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:13:05.018913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6473ef-3417-4421-83f6-7636ba11240d None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:05.019280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6473ef-3417-4421-83f6-7636ba11240d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:05.019660 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6473ef-3417-4421-83f6-7636ba11240d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:05.037850 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-6d6473ef-3417-4421-83f6-7636ba11240d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:05.039908 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-6d6473ef-3417-4421-83f6-7636ba11240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:05.104945 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1205/2425] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:05.114863 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:05.116731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:05.186119 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e97e76-ad8a-4899-8884-645768f2da8b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:05.190272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afddd9f-73e1-4ec5-a9ab-e28d844b6ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:05.191190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afddd9f-73e1-4ec5-a9ab-e28d844b6ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:05.191780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afddd9f-73e1-4ec5-a9ab-e28d844b6ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:05.192209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afddd9f-73e1-4ec5-a9ab-e28d844b6ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:05.205164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afddd9f-73e1-4ec5-a9ab-e28d844b6ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:05.207531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afddd9f-73e1-4ec5-a9ab-e28d844b6ed6 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:05.220371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1221/2426] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:13:05.530778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6473ef-3417-4421-83f6-7636ba11240d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:05.533221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-6d6473ef-3417-4421-83f6-7636ba11240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:05.560640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6473ef-3417-4421-83f6-7636ba11240d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:05.571403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:05.572416 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:05.572888 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:05.573517 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] PATH_INFO: `/v3/projects/1d9627a2d03a49aeadaa16e21f4839a5` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:05.574940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9627a2d03a49aeadaa16e21f4839a5)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:05.577042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:05.636984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9627a2d03a49aeadaa16e21f4839a5', 'request_id': 'req-0fc825d4-78bd-4db8-b454-03446e39f81f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:05.643001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9627a2d03a49aeadaa16e21f4839a5', 'request_id': 'req-0fc825d4-78bd-4db8-b454-03446e39f81f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:05.649347 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9627a2d03a49aeadaa16e21f4839a5', 'request_id': 'req-0fc825d4-78bd-4db8-b454-03446e39f81f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:05.665213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] The token cache is being invalidate because project 1d9627a2d03a49aeadaa16e21f4839a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:05.665601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:05.666140 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:05.669262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1206/2427] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:13:05 2021] DELETE /identity/v3/projects/1d9627a2d03a49aeadaa16e21f4839a5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:05.674661 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b74a0-5625-4e53-8299-f5f2d34f1a56 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:05.674953 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b74a0-5625-4e53-8299-f5f2d34f1a56 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:05.675232 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b74a0-5625-4e53-8299-f5f2d34f1a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:05.692444 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2e7b74a0-5625-4e53-8299-f5f2d34f1a56 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:05.693662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2e7b74a0-5625-4e53-8299-f5f2d34f1a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:05.751359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:05.752943 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:05.766482 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1222/2428] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:05.774045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3112c-89e1-42cf-ad47-03a0823c01bb None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:05.775123 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3112c-89e1-42cf-ad47-03a0823c01bb None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:05.776626 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3112c-89e1-42cf-ad47-03a0823c01bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:05.797267 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ccc3112c-89e1-42cf-ad47-03a0823c01bb None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:05.798663 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ccc3112c-89e1-42cf-ad47-03a0823c01bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:05.806488 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1223/2429] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:13:05.810577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3112c-89e1-42cf-ad47-03a0823c01bb None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:05.819373 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3112c-89e1-42cf-ad47-03a0823c01bb None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:05.820892 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc825d4-78bd-4db8-b454-03446e39f81f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:05.824489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887875e9-81f6-43bb-af2a-45ca3ef91aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:05.825123 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887875e9-81f6-43bb-af2a-45ca3ef91aee admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:05.825405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887875e9-81f6-43bb-af2a-45ca3ef91aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:05.825682 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887875e9-81f6-43bb-af2a-45ca3ef91aee admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:05.826412 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:05.826547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887875e9-81f6-43bb-af2a-45ca3ef91aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:13:05.826732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887875e9-81f6-43bb-af2a-45ca3ef91aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:05.827239 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:05.827513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:05.827781 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0 admin admin] PATH_INFO: `/v3/projects/c20cecde252949ed94b9e3dace954c5a` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:05.828319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887875e9-81f6-43bb-af2a-45ca3ef91aee admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:05.828951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20cecde252949ed94b9e3dace954c5a)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:05.830854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:05.840150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1224/2430] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:13:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 01:13:05.844862 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887875e9-81f6-43bb-af2a-45ca3ef91aee admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:05.855472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887875e9-81f6-43bb-af2a-45ca3ef91aee admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:05.860538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67720090-7210-480a-ab32-be6ab7577e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:05.861212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67720090-7210-480a-ab32-be6ab7577e8e admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:05.861559 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67720090-7210-480a-ab32-be6ab7577e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:05.861773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67720090-7210-480a-ab32-be6ab7577e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:05.862529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67720090-7210-480a-ab32-be6ab7577e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:05.864468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67720090-7210-480a-ab32-be6ab7577e8e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:05.878842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20cecde252949ed94b9e3dace954c5a', 'request_id': 'req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:05.884852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20cecde252949ed94b9e3dace954c5a', 'request_id': 'req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:05.890434 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1225/2431] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:05 2021] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:13:05.891470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20cecde252949ed94b9e3dace954c5a', 'request_id': 'req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:05.894796 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67720090-7210-480a-ab32-be6ab7577e8e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:05.904492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0 admin admin] The token cache is being invalidate because project c20cecde252949ed94b9e3dace954c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:05.904784 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:05.905430 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-20e0a9d6-d905-41fc-9a4f-db9bc20996e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:05.907239 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1207/2432] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:13:05 2021] DELETE /identity/v3/projects/c20cecde252949ed94b9e3dace954c5a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:13:05.912601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a09e-d14f-4d3e-a88e-b25c6b9c8226 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:05.912893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a09e-d14f-4d3e-a88e-b25c6b9c8226 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:05.913176 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a09e-d14f-4d3e-a88e-b25c6b9c8226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:05.931766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-9765a09e-d14f-4d3e-a88e-b25c6b9c8226 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:05.933588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9765a09e-d14f-4d3e-a88e-b25c6b9c8226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:05.956919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67720090-7210-480a-ab32-be6ab7577e8e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:05.961563 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482db4e-8485-4261-b1de-56899e1f2f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:05.962229 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482db4e-8485-4261-b1de-56899e1f2f99 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:05.962538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482db4e-8485-4261-b1de-56899e1f2f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:05.962815 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482db4e-8485-4261-b1de-56899e1f2f99 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:05.963805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482db4e-8485-4261-b1de-56899e1f2f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:05.965986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482db4e-8485-4261-b1de-56899e1f2f99 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:05.985785 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1226/2433] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:13:05 2021] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:05.989932 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482db4e-8485-4261-b1de-56899e1f2f99 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:05.991093 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1208/2434] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:13:05.995369 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-7482db4e-8485-4261-b1de-56899e1f2f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:05.999947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837fb72-747c-426d-bf1d-0e0cdf4d23c7 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.000256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837fb72-747c-426d-bf1d-0e0cdf4d23c7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.000538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837fb72-747c-426d-bf1d-0e0cdf4d23c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.007868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482db4e-8485-4261-b1de-56899e1f2f99 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.012673 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb8629-ae1d-4c0a-a2b8-e2b5ba0c2d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.013331 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb8629-ae1d-4c0a-a2b8-e2b5ba0c2d70 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.013616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb8629-ae1d-4c0a-a2b8-e2b5ba0c2d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.013944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb8629-ae1d-4c0a-a2b8-e2b5ba0c2d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.014801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb8629-ae1d-4c0a-a2b8-e2b5ba0c2d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.016413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb8629-ae1d-4c0a-a2b8-e2b5ba0c2d70 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.019571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-2837fb72-747c-426d-bf1d-0e0cdf4d23c7 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:06.020779 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2837fb72-747c-426d-bf1d-0e0cdf4d23c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:06.026799 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1227/2435] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:05 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:13:06.029047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1209/2436] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:06.030621 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb8629-ae1d-4c0a-a2b8-e2b5ba0c2d70 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.033008 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837fb72-747c-426d-bf1d-0e0cdf4d23c7 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.040572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb8629-ae1d-4c0a-a2b8-e2b5ba0c2d70 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.042539 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837fb72-747c-426d-bf1d-0e0cdf4d23c7 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.046564 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00ff03-6de8-4823-9e93-f93520a613c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.047154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fa118-0505-4cba-a6d1-926b6223a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.047282 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00ff03-6de8-4823-9e93-f93520a613c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.047573 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00ff03-6de8-4823-9e93-f93520a613c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.047789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fa118-0505-4cba-a6d1-926b6223a0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.047895 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00ff03-6de8-4823-9e93-f93520a613c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.048072 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fa118-0505-4cba-a6d1-926b6223a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.048349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fa118-0505-4cba-a6d1-926b6223a0f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.048577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00ff03-6de8-4823-9e93-f93520a613c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.049103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fa118-0505-4cba-a6d1-926b6223a0f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:13:06.049409 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fa118-0505-4cba-a6d1-926b6223a0f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.050182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00ff03-6de8-4823-9e93-f93520a613c4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.051019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fa118-0505-4cba-a6d1-926b6223a0f4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.061212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1228/2437] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:06.065211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00ff03-6de8-4823-9e93-f93520a613c4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.069171 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1210/2438] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:13:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:13:06.070058 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fa118-0505-4cba-a6d1-926b6223a0f4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.075105 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00ff03-6de8-4823-9e93-f93520a613c4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.079720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fa118-0505-4cba-a6d1-926b6223a0f4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.079878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a50ac-926d-4021-84f0-db319378fc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.080714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a50ac-926d-4021-84f0-db319378fc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.080996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a50ac-926d-4021-84f0-db319378fc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.081277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a50ac-926d-4021-84f0-db319378fc4b admin admin] PATH_INFO: `/v3/projects/0d7a37a1bbb54be1bbd19bd75acb8c47/users/3ceca2106a3a4440bf58737f64c37c81/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.084511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fc216-601f-4e4a-a6d5-9ff87d09bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.085136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fc216-601f-4e4a-a6d5-9ff87d09bcbb admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.085421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fc216-601f-4e4a-a6d5-9ff87d09bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.085700 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fc216-601f-4e4a-a6d5-9ff87d09bcbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.086418 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fc216-601f-4e4a-a6d5-9ff87d09bcbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.088300 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fc216-601f-4e4a-a6d5-9ff87d09bcbb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.096341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a50ac-926d-4021-84f0-db319378fc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7a37a1bbb54be1bbd19bd75acb8c47, user_id=3ceca2106a3a4440bf58737f64c37c81, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.098973 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a50ac-926d-4021-84f0-db319378fc4b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.112330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1229/2439] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:06 2021] PUT /identity/v3/projects/0d7a37a1bbb54be1bbd19bd75acb8c47/users/3ceca2106a3a4440bf58737f64c37c81/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:13:06.118247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1211/2440] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:06 2021] POST /identity/v3/projects => generated 397 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:13:06.120026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a50ac-926d-4021-84f0-db319378fc4b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.122733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5da40-8676-4114-8028-9712f5eba113 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.123023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5da40-8676-4114-8028-9712f5eba113 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.123296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5da40-8676-4114-8028-9712f5eba113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.149437 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-2bd5da40-8676-4114-8028-9712f5eba113 None None] MFA Rules not processed for user `3ceca2106a3a4440bf58737f64c37c81`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:06.151219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2bd5da40-8676-4114-8028-9712f5eba113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:06.180503 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a50ac-926d-4021-84f0-db319378fc4b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.218588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1212/2441] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:06 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:13:06.222922 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5da40-8676-4114-8028-9712f5eba113 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.237540 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b696d93-e340-409e-8f5c-c1eacfe431d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.238215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b696d93-e340-409e-8f5c-c1eacfe431d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.238609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b696d93-e340-409e-8f5c-c1eacfe431d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.238887 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b696d93-e340-409e-8f5c-c1eacfe431d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.239604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b696d93-e340-409e-8f5c-c1eacfe431d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.241560 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b696d93-e340-409e-8f5c-c1eacfe431d4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.262240 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1230/2442] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:13:06 2021] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:06.266660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b696d93-e340-409e-8f5c-c1eacfe431d4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.277648 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b696d93-e340-409e-8f5c-c1eacfe431d4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.282774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c986c9-a128-4775-a0f7-ed49d7aeda42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.283437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c986c9-a128-4775-a0f7-ed49d7aeda42 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.283724 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c986c9-a128-4775-a0f7-ed49d7aeda42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.284025 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c986c9-a128-4775-a0f7-ed49d7aeda42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.284761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c986c9-a128-4775-a0f7-ed49d7aeda42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.287038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c986c9-a128-4775-a0f7-ed49d7aeda42 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.289340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5da40-8676-4114-8028-9712f5eba113 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.299297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1231/2443] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:13:06.303375 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c986c9-a128-4775-a0f7-ed49d7aeda42 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.310275 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbd297-fb54-42f8-af09-6765a55189f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.311114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbd297-fb54-42f8-af09-6765a55189f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.311395 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbd297-fb54-42f8-af09-6765a55189f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.311665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbd297-fb54-42f8-af09-6765a55189f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.315895 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbd297-fb54-42f8-af09-6765a55189f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.317551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbd297-fb54-42f8-af09-6765a55189f8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.324759 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c986c9-a128-4775-a0f7-ed49d7aeda42 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.330860 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046e48-6faf-412d-a496-25c594e0a44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.331532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046e48-6faf-412d-a496-25c594e0a44b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.331817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046e48-6faf-412d-a496-25c594e0a44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.332094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046e48-6faf-412d-a496-25c594e0a44b admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.332838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046e48-6faf-412d-a496-25c594e0a44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.334462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046e48-6faf-412d-a496-25c594e0a44b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.350443 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1232/2444] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:06 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:13:06.353038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046e48-6faf-412d-a496-25c594e0a44b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.361069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1213/2445] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:06 2021] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:13:06.367594 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046e48-6faf-412d-a496-25c594e0a44b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.368709 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbd297-fb54-42f8-af09-6765a55189f8 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.430260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf578f-9f86-4133-bc65-1b2bc32ab3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.431540 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf578f-9f86-4133-bc65-1b2bc32ab3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.431915 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbd297-fb54-42f8-af09-6765a55189f8 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.432101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf578f-9f86-4133-bc65-1b2bc32ab3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.432400 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf578f-9f86-4133-bc65-1b2bc32ab3b4 admin admin] PATH_INFO: `/v3/projects/5fed8aa68f2c4d609b594c43776770f5/users/b38a645cc70c4065b785c194c62bda52/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.438462 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c8ca5-1a4c-4ac2-8bf2-1f1a499bd176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.439205 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c8ca5-1a4c-4ac2-8bf2-1f1a499bd176 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.439552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c8ca5-1a4c-4ac2-8bf2-1f1a499bd176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.439887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c8ca5-1a4c-4ac2-8bf2-1f1a499bd176 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.440743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c8ca5-1a4c-4ac2-8bf2-1f1a499bd176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.443386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c8ca5-1a4c-4ac2-8bf2-1f1a499bd176 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.447951 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf578f-9f86-4133-bc65-1b2bc32ab3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fed8aa68f2c4d609b594c43776770f5, user_id=b38a645cc70c4065b785c194c62bda52, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.450621 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf578f-9f86-4133-bc65-1b2bc32ab3b4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.467132 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1233/2446] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:06 2021] PUT /identity/v3/projects/5fed8aa68f2c4d609b594c43776770f5/users/b38a645cc70c4065b785c194c62bda52/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:06.467780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1214/2447] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:13:06 2021] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:06.475527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf578f-9f86-4133-bc65-1b2bc32ab3b4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.481155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d085f-dcf0-40cb-acd1-dc2209d6b76d None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.481450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d085f-dcf0-40cb-acd1-dc2209d6b76d None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.481732 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d085f-dcf0-40cb-acd1-dc2209d6b76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.508236 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-bc0d085f-dcf0-40cb-acd1-dc2209d6b76d None None] MFA Rules not processed for user `b38a645cc70c4065b785c194c62bda52`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:06.509448 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-bc0d085f-dcf0-40cb-acd1-dc2209d6b76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:06.539265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf578f-9f86-4133-bc65-1b2bc32ab3b4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.545031 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfa2fd-87ac-4fd0-a03b-b4e0b240184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.545682 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfa2fd-87ac-4fd0-a03b-b4e0b240184b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.545966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfa2fd-87ac-4fd0-a03b-b4e0b240184b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.546308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfa2fd-87ac-4fd0-a03b-b4e0b240184b admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.547010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cfa2fd-87ac-4fd0-a03b-b4e0b240184b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.548595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cfa2fd-87ac-4fd0-a03b-b4e0b240184b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.558685 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1234/2448] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:06 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:13:06.562907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfa2fd-87ac-4fd0-a03b-b4e0b240184b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.573042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfa2fd-87ac-4fd0-a03b-b4e0b240184b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.580458 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0dd72-c15d-4db0-9587-34691d286324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.581109 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0dd72-c15d-4db0-9587-34691d286324 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.581632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0dd72-c15d-4db0-9587-34691d286324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.582081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0dd72-c15d-4db0-9587-34691d286324 admin admin] PATH_INFO: `/v3/projects/88f525dc876f46448f06fa36dd06a5c9/users/c82653dbea6144abbdce32577265d61b/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.602213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1215/2449] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:06 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:13:06.610426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0dd72-c15d-4db0-9587-34691d286324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f525dc876f46448f06fa36dd06a5c9, user_id=c82653dbea6144abbdce32577265d61b, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.613247 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0dd72-c15d-4db0-9587-34691d286324 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.616692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d085f-dcf0-40cb-acd1-dc2209d6b76d None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.618394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-bc0d085f-dcf0-40cb-acd1-dc2209d6b76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:06.629230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1235/2450] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:06 2021] PUT /identity/v3/projects/88f525dc876f46448f06fa36dd06a5c9/users/c82653dbea6144abbdce32577265d61b/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:13:06.632942 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0dd72-c15d-4db0-9587-34691d286324 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.689789 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d085f-dcf0-40cb-acd1-dc2209d6b76d None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.706221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0dd72-c15d-4db0-9587-34691d286324 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.711260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcebc36-6dc2-464b-bdb1-5a8c5aa2877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.711958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcebc36-6dc2-464b-bdb1-5a8c5aa2877b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.712239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcebc36-6dc2-464b-bdb1-5a8c5aa2877b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.712516 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcebc36-6dc2-464b-bdb1-5a8c5aa2877b admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.713845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcebc36-6dc2-464b-bdb1-5a8c5aa2877b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.716296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcebc36-6dc2-464b-bdb1-5a8c5aa2877b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.727128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1236/2451] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:06 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:06.731382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcebc36-6dc2-464b-bdb1-5a8c5aa2877b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.741614 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcebc36-6dc2-464b-bdb1-5a8c5aa2877b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.751043 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3793dc-46c9-4df8-9bc2-0272af72752d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.751206 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e2ad4-01d8-4961-baf0-fbce71cef5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.751340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3793dc-46c9-4df8-9bc2-0272af72752d service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.751437 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e2ad4-01d8-4961-baf0-fbce71cef5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.751535 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3793dc-46c9-4df8-9bc2-0272af72752d service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.751631 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e2ad4-01d8-4961-baf0-fbce71cef5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.751720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3793dc-46c9-4df8-9bc2-0272af72752d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.751816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e2ad4-01d8-4961-baf0-fbce71cef5a2 admin admin] PATH_INFO: `/v3/projects/88f525dc876f46448f06fa36dd06a5c9/users/c82653dbea6144abbdce32577265d61b/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.752556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e2ad4-01d8-4961-baf0-fbce71cef5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f525dc876f46448f06fa36dd06a5c9, user_id=c82653dbea6144abbdce32577265d61b, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.755867 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e2ad4-01d8-4961-baf0-fbce71cef5a2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.771085 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1237/2452] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:06 2021] PUT /identity/v3/projects/88f525dc876f46448f06fa36dd06a5c9/users/c82653dbea6144abbdce32577265d61b/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:13:06.782727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9b61b-0177-48bc-bcec-9184a33ed63a None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.783181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9b61b-0177-48bc-bcec-9184a33ed63a None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.783461 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9b61b-0177-48bc-bcec-9184a33ed63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:06.813103 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-f5c9b61b-0177-48bc-bcec-9184a33ed63a None None] MFA Rules not processed for user `c82653dbea6144abbdce32577265d61b`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:06.814517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f5c9b61b-0177-48bc-bcec-9184a33ed63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:06.821704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3793dc-46c9-4df8-9bc2-0272af72752d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:06.823876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3793dc-46c9-4df8-9bc2-0272af72752d service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:06.832963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1216/2453] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:06 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:06.907782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1238/2454] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:06 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:06.917567 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3793dc-46c9-4df8-9bc2-0272af72752d service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:06.926561 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3793dc-46c9-4df8-9bc2-0272af72752d service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:06.987129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c369-094b-4548-b9f0-334531e028e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:06.987901 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c369-094b-4548-b9f0-334531e028e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:06.988246 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c369-094b-4548-b9f0-334531e028e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:06.988614 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c369-094b-4548-b9f0-334531e028e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:07.045704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c369-094b-4548-b9f0-334531e028e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:07.047200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c369-094b-4548-b9f0-334531e028e9 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:07.056128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1217/2455] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:06 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:13:15.776928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9b61b-0177-48bc-bcec-9184a33ed63a None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:15.778517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f5c9b61b-0177-48bc-bcec-9184a33ed63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:15.797534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9b61b-0177-48bc-bcec-9184a33ed63a None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:15.801788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44764f7d-e33b-4596-b34d-374fff34581b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:15.802537 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44764f7d-e33b-4596-b34d-374fff34581b service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:15.802748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44764f7d-e33b-4596-b34d-374fff34581b service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:15.803031 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44764f7d-e33b-4596-b34d-374fff34581b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:15.813179 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44764f7d-e33b-4596-b34d-374fff34581b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:15.814647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44764f7d-e33b-4596-b34d-374fff34581b service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:15.836832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1239/2456] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:15 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:16.928451 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c369-094b-4548-b9f0-334531e028e9 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:16.988970 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c369-094b-4548-b9f0-334531e028e9 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:16.993458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:16.994307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:16.994616 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:16.995881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] PATH_INFO: `/v3/users/b38a645cc70c4065b785c194c62bda52` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:16.997079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38a645cc70c4065b785c194c62bda52)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:16.999019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:17.043302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38a645cc70c4065b785c194c62bda52'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:17.049824 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38a645cc70c4065b785c194c62bda52'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:17.050497 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38a645cc70c4065b785c194c62bda52'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:17.051106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38a645cc70c4065b785c194c62bda52'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:17.063256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38a645cc70c4065b785c194c62bda52'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:17.076511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1218/2457] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:13:16 2021] DELETE /identity/v3/users/b38a645cc70c4065b785c194c62bda52 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:17.080976 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b9c7b-d606-433c-aaac-47c9d9e758d3 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:17.081439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b9c7b-d606-433c-aaac-47c9d9e758d3 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:17.081557 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b9c7b-d606-433c-aaac-47c9d9e758d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:17.098740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-264b9c7b-d606-433c-aaac-47c9d9e758d3 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:17.099980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-264b9c7b-d606-433c-aaac-47c9d9e758d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:17.160917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1240/2458] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:13:17.171542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:17.172936 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:17.230752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeda61b-0695-4734-b7ee-d3d5706b72c6 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:17.234419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d32ca2-0cd2-48fc-ab71-10c44599a5bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:17.235177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d32ca2-0cd2-48fc-ab71-10c44599a5bb service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:17.235573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d32ca2-0cd2-48fc-ab71-10c44599a5bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:17.235860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d32ca2-0cd2-48fc-ab71-10c44599a5bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:17.245765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d32ca2-0cd2-48fc-ab71-10c44599a5bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:17.247216 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d32ca2-0cd2-48fc-ab71-10c44599a5bb service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:17.256884 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1219/2459] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:17.593988 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b9c7b-d606-433c-aaac-47c9d9e758d3 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:17.595520 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-264b9c7b-d606-433c-aaac-47c9d9e758d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:17.608707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b9c7b-d606-433c-aaac-47c9d9e758d3 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:17.613722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:17.619271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:17.619553 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:17.620445 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] PATH_INFO: `/v3/projects/5fed8aa68f2c4d609b594c43776770f5` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:17.622470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fed8aa68f2c4d609b594c43776770f5)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:17.624402 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:17.685319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fed8aa68f2c4d609b594c43776770f5', 'request_id': 'req-e89901bd-f8ca-40da-ab7b-c31946868f94'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:17.691585 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fed8aa68f2c4d609b594c43776770f5', 'request_id': 'req-e89901bd-f8ca-40da-ab7b-c31946868f94'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:17.702983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fed8aa68f2c4d609b594c43776770f5', 'request_id': 'req-e89901bd-f8ca-40da-ab7b-c31946868f94'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:17.712113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] The token cache is being invalidate because project 5fed8aa68f2c4d609b594c43776770f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:17.712405 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:17.713073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:17.715533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1241/2460] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:13:17 2021] DELETE /identity/v3/projects/5fed8aa68f2c4d609b594c43776770f5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:45.631333 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d32ca2-0cd2-48fc-ab71-10c44599a5bb service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:45.640562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d32ca2-0cd2-48fc-ab71-10c44599a5bb service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:45.687990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae53bae-4bbc-4c6d-8057-b3690843e8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:45.688639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae53bae-4bbc-4c6d-8057-b3690843e8ae service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:45.688938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae53bae-4bbc-4c6d-8057-b3690843e8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:45.689192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae53bae-4bbc-4c6d-8057-b3690843e8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:45.691013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0ae53bae-4bbc-4c6d-8057-b3690843e8ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:45.767958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae53bae-4bbc-4c6d-8057-b3690843e8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:45.769389 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae53bae-4bbc-4c6d-8057-b3690843e8ae service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:45.780510 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1220/2461] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:45.814813 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:45.816394 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:45.887293 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89901bd-f8ca-40da-ab7b-c31946868f94 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:45.891845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:45.892717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:45.892999 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:45.893274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] PATH_INFO: `/v3/users/3ceca2106a3a4440bf58737f64c37c81` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:45.894504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ceca2106a3a4440bf58737f64c37c81)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:45.896455 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:45.952693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ceca2106a3a4440bf58737f64c37c81'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:45.953346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ceca2106a3a4440bf58737f64c37c81'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:45.961603 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ceca2106a3a4440bf58737f64c37c81'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:45.963576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ceca2106a3a4440bf58737f64c37c81'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:45.975985 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ceca2106a3a4440bf58737f64c37c81'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:45.989226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1242/2462] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:13:45 2021] DELETE /identity/v3/users/3ceca2106a3a4440bf58737f64c37c81 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:45.994274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a66805-5738-4393-9622-eb420239aceb None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:45.994593 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a66805-5738-4393-9622-eb420239aceb None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:45.994874 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a66805-5738-4393-9622-eb420239aceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:46.011732 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-14a66805-5738-4393-9622-eb420239aceb None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:46.012973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-14a66805-5738-4393-9622-eb420239aceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:46.076891 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1221/2463] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:13:46.086779 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:46.088257 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:46.146189 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a8a43-38d2-4c67-a159-049664a3c4de admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:46.150514 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb165dad-b8ff-4b3b-86c1-c03b714d1e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:46.151350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb165dad-b8ff-4b3b-86c1-c03b714d1e16 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:46.151639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb165dad-b8ff-4b3b-86c1-c03b714d1e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:46.151919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb165dad-b8ff-4b3b-86c1-c03b714d1e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:46.161625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb165dad-b8ff-4b3b-86c1-c03b714d1e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:46.163125 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb165dad-b8ff-4b3b-86c1-c03b714d1e16 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:46.173410 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1243/2464] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:46.515667 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a66805-5738-4393-9622-eb420239aceb None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:46.517114 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-14a66805-5738-4393-9622-eb420239aceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:46.546165 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a66805-5738-4393-9622-eb420239aceb None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:46.580849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:46.581743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:46.582027 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:46.582306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] PATH_INFO: `/v3/projects/0d7a37a1bbb54be1bbd19bd75acb8c47` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:46.583993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7a37a1bbb54be1bbd19bd75acb8c47)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:46.586067 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:46.676280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7a37a1bbb54be1bbd19bd75acb8c47', 'request_id': 'req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:46.686687 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7a37a1bbb54be1bbd19bd75acb8c47', 'request_id': 'req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:46.694056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7a37a1bbb54be1bbd19bd75acb8c47', 'request_id': 'req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:46.718221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] The token cache is being invalidate because project 0d7a37a1bbb54be1bbd19bd75acb8c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:46.719016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:46.720036 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:46.721771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1222/2465] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:13:46 2021] DELETE /identity/v3/projects/0d7a37a1bbb54be1bbd19bd75acb8c47 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:46.726106 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb165dad-b8ff-4b3b-86c1-c03b714d1e16 service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:46.739174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb165dad-b8ff-4b3b-86c1-c03b714d1e16 service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:46.814659 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef60f9f-e587-41aa-a735-3d4674cfc811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:46.816154 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef60f9f-e587-41aa-a735-3d4674cfc811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:46.817238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef60f9f-e587-41aa-a735-3d4674cfc811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:46.817784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef60f9f-e587-41aa-a735-3d4674cfc811 admin admin] PATH_INFO: `/v3/users/c82653dbea6144abbdce32577265d61b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:46.819773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef60f9f-e587-41aa-a735-3d4674cfc811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82653dbea6144abbdce32577265d61b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:46.823310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef60f9f-e587-41aa-a735-3d4674cfc811 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:46.895643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9ef60f9f-e587-41aa-a735-3d4674cfc811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82653dbea6144abbdce32577265d61b'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:46.896307 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9ef60f9f-e587-41aa-a735-3d4674cfc811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82653dbea6144abbdce32577265d61b'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:46.903752 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9ef60f9f-e587-41aa-a735-3d4674cfc811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82653dbea6144abbdce32577265d61b'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:46.904347 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9ef60f9f-e587-41aa-a735-3d4674cfc811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82653dbea6144abbdce32577265d61b'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:46.917572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9ef60f9f-e587-41aa-a735-3d4674cfc811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82653dbea6144abbdce32577265d61b'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:46.932726 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1244/2466] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:13:46 2021] DELETE /identity/v3/users/c82653dbea6144abbdce32577265d61b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:47.484516 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:47.486538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:47.500603 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd3f4-efb2-4093-8bdd-5a65b3ba3b43 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:47.565493 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:47.566345 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:47.566654 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:47.566932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] PATH_INFO: `/v3/projects/88f525dc876f46448f06fa36dd06a5c9` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:47.568268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f525dc876f46448f06fa36dd06a5c9)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:47.570491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:47.627960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f525dc876f46448f06fa36dd06a5c9', 'request_id': 'req-a6cd7aed-73fd-4b57-83e6-92aca536b46a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:47.635704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f525dc876f46448f06fa36dd06a5c9', 'request_id': 'req-a6cd7aed-73fd-4b57-83e6-92aca536b46a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:47.642404 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f525dc876f46448f06fa36dd06a5c9', 'request_id': 'req-a6cd7aed-73fd-4b57-83e6-92aca536b46a'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:47.656354 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] The token cache is being invalidate because project 88f525dc876f46448f06fa36dd06a5c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:47.656643 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:47.657532 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:47.662452 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1223/2467] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:13:47 2021] DELETE /identity/v3/projects/88f525dc876f46448f06fa36dd06a5c9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:47.666290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de22f0-5582-4897-beea-9774798b0dea None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:47.666652 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de22f0-5582-4897-beea-9774798b0dea None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:47.666957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de22f0-5582-4897-beea-9774798b0dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:47.696370 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-19de22f0-5582-4897-beea-9774798b0dea None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:47.698224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-19de22f0-5582-4897-beea-9774798b0dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:47.795404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1245/2468] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:47.799236 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:47.799236 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:47.804310 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b5a6-0a86-4e17-82ef-4c1e37c42288 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:47.804583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b5a6-0a86-4e17-82ef-4c1e37c42288 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:47.804862 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b5a6-0a86-4e17-82ef-4c1e37c42288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:47.835179 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-1c67b5a6-0a86-4e17-82ef-4c1e37c42288 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:47.836562 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1c67b5a6-0a86-4e17-82ef-4c1e37c42288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:47.862499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1246/2469] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:47.867580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67b5a6-0a86-4e17-82ef-4c1e37c42288 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:47.875916 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd7aed-73fd-4b57-83e6-92aca536b46a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:47.881261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c639e-cd5f-4fd6-97c5-b400ad60efae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:47.884419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c639e-cd5f-4fd6-97c5-b400ad60efae service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:47.884774 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c639e-cd5f-4fd6-97c5-b400ad60efae service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:47.884966 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c639e-cd5f-4fd6-97c5-b400ad60efae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:47.887208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7a7c639e-cd5f-4fd6-97c5-b400ad60efae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:47.907165 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67b5a6-0a86-4e17-82ef-4c1e37c42288 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:47.918554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f511-0e75-43fd-8781-563547be8729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:47.919508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f511-0e75-43fd-8781-563547be8729 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:47.920061 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f511-0e75-43fd-8781-563547be8729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:47.920901 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f511-0e75-43fd-8781-563547be8729 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:47.922589 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f511-0e75-43fd-8781-563547be8729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:13:47.923088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f511-0e75-43fd-8781-563547be8729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:47.925358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f511-0e75-43fd-8781-563547be8729 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:47.941263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1247/2470] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:13:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:13:47.944773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f511-0e75-43fd-8781-563547be8729 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:47.958568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f511-0e75-43fd-8781-563547be8729 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:47.966311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b37b14-ea55-43f8-be92-0d3dae8b5fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:47.967092 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b37b14-ea55-43f8-be92-0d3dae8b5fdb admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:47.967478 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b37b14-ea55-43f8-be92-0d3dae8b5fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:47.967655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b37b14-ea55-43f8-be92-0d3dae8b5fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:47.969133 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b37b14-ea55-43f8-be92-0d3dae8b5fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:47.970813 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b37b14-ea55-43f8-be92-0d3dae8b5fdb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:47.981283 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c639e-cd5f-4fd6-97c5-b400ad60efae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:47.982785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c639e-cd5f-4fd6-97c5-b400ad60efae service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:47.995096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1224/2471] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:47 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:48.025783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1248/2472] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:47 2021] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:13:48.027691 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c639e-cd5f-4fd6-97c5-b400ad60efae service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:48.042330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c639e-cd5f-4fd6-97c5-b400ad60efae service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:48.174887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439133b0-811d-48e9-89c3-eb4d6753c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:48.177098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439133b0-811d-48e9-89c3-eb4d6753c132 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:48.177531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439133b0-811d-48e9-89c3-eb4d6753c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:48.177954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439133b0-811d-48e9-89c3-eb4d6753c132 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:48.182201 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439133b0-811d-48e9-89c3-eb4d6753c132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:48.185293 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439133b0-811d-48e9-89c3-eb4d6753c132 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:48.240721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1225/2473] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:13:48 2021] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:48.242636 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b37b14-ea55-43f8-be92-0d3dae8b5fdb admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:48.287324 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b37b14-ea55-43f8-be92-0d3dae8b5fdb admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:48.292229 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25859b00-69fa-4a4d-b4aa-94907e5c4fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:48.292898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25859b00-69fa-4a4d-b4aa-94907e5c4fec admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:48.293181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25859b00-69fa-4a4d-b4aa-94907e5c4fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:48.293449 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25859b00-69fa-4a4d-b4aa-94907e5c4fec admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:48.294191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25859b00-69fa-4a4d-b4aa-94907e5c4fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:48.296495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25859b00-69fa-4a4d-b4aa-94907e5c4fec admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:48.307921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1249/2474] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:48 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:48.311706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439133b0-811d-48e9-89c3-eb4d6753c132 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:48.325755 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439133b0-811d-48e9-89c3-eb4d6753c132 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:48.341307 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eab7eb-3554-4caf-a733-f12855b66442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:48.341843 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eab7eb-3554-4caf-a733-f12855b66442 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:48.342176 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eab7eb-3554-4caf-a733-f12855b66442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:48.342482 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eab7eb-3554-4caf-a733-f12855b66442 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:48.343410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eab7eb-3554-4caf-a733-f12855b66442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:48.345018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eab7eb-3554-4caf-a733-f12855b66442 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:48.363054 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1226/2475] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:48 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:48.367050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25859b00-69fa-4a4d-b4aa-94907e5c4fec admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:48.378517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25859b00-69fa-4a4d-b4aa-94907e5c4fec admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:48.394252 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1851e2-bc08-4cd4-85d2-c596963990d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:48.395409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1851e2-bc08-4cd4-85d2-c596963990d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:48.395864 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1851e2-bc08-4cd4-85d2-c596963990d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:48.396222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1851e2-bc08-4cd4-85d2-c596963990d4 admin admin] PATH_INFO: `/v3/projects/171ee2374ad945babd3393a80eb1474e/users/3b1853f1825648c79af3f6842dd771fa/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:48.414042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1851e2-bc08-4cd4-85d2-c596963990d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=171ee2374ad945babd3393a80eb1474e, user_id=3b1853f1825648c79af3f6842dd771fa, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:48.417850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1851e2-bc08-4cd4-85d2-c596963990d4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:48.447641 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a2fb8-782e-424d-b724-c6abcbb0726b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:48.447963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a2fb8-782e-424d-b724-c6abcbb0726b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:48.448194 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a2fb8-782e-424d-b724-c6abcbb0726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:48.450212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1250/2476] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:48 2021] PUT /identity/v3/projects/171ee2374ad945babd3393a80eb1474e/users/3b1853f1825648c79af3f6842dd771fa/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:48.480382 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-630a2fb8-782e-424d-b724-c6abcbb0726b None None] MFA Rules not processed for user `3b1853f1825648c79af3f6842dd771fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:48.481914 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-630a2fb8-782e-424d-b724-c6abcbb0726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:48.604431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1227/2477] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:48 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:48.609095 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1851e2-bc08-4cd4-85d2-c596963990d4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:48.688175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1851e2-bc08-4cd4-85d2-c596963990d4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:48.694908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3308f2-7403-443e-adc1-5a3423fee1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:48.695691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3308f2-7403-443e-adc1-5a3423fee1ff admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:48.696068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3308f2-7403-443e-adc1-5a3423fee1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:48.696506 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3308f2-7403-443e-adc1-5a3423fee1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:48.697951 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3308f2-7403-443e-adc1-5a3423fee1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:48.699997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3308f2-7403-443e-adc1-5a3423fee1ff admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:48.728904 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1251/2478] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:48 2021] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:48.733066 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a2fb8-782e-424d-b724-c6abcbb0726b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:48.745830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a2fb8-782e-424d-b724-c6abcbb0726b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:48.819112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144a41-4474-41b5-a6da-29132b7feb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:48.820499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144a41-4474-41b5-a6da-29132b7feb85 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:48.820954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144a41-4474-41b5-a6da-29132b7feb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:48.821396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144a41-4474-41b5-a6da-29132b7feb85 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:48.822930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144a41-4474-41b5-a6da-29132b7feb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:48.825060 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144a41-4474-41b5-a6da-29132b7feb85 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:48.858683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1228/2479] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:13:48 2021] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:13:48.860660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3308f2-7403-443e-adc1-5a3423fee1ff admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:48.873514 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3308f2-7403-443e-adc1-5a3423fee1ff admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:48.878617 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db0fd4-132e-4053-8806-f0eea0fa40be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:48.879290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db0fd4-132e-4053-8806-f0eea0fa40be admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:48.879574 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db0fd4-132e-4053-8806-f0eea0fa40be admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:48.880029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db0fd4-132e-4053-8806-f0eea0fa40be admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:48.880960 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db0fd4-132e-4053-8806-f0eea0fa40be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:48.882631 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db0fd4-132e-4053-8806-f0eea0fa40be admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:48.895995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1252/2480] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:48 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:13:48.900133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144a41-4474-41b5-a6da-29132b7feb85 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:48.913244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144a41-4474-41b5-a6da-29132b7feb85 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:48.920261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b362d-020c-467e-87ac-e88ec6d92388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:48.921662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b362d-020c-467e-87ac-e88ec6d92388 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:48.922632 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b362d-020c-467e-87ac-e88ec6d92388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:48.923066 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b362d-020c-467e-87ac-e88ec6d92388 admin admin] PATH_INFO: `/v3/projects/c5b88faba2b349308e555cd33c33f621/users/ec7adef97edc4441be00e2da9e2b22a8/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:48.941792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b362d-020c-467e-87ac-e88ec6d92388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b88faba2b349308e555cd33c33f621, user_id=ec7adef97edc4441be00e2da9e2b22a8, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:48.944987 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b362d-020c-467e-87ac-e88ec6d92388 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:48.973953 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1229/2481] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:48 2021] PUT /identity/v3/projects/c5b88faba2b349308e555cd33c33f621/users/ec7adef97edc4441be00e2da9e2b22a8/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:48.975268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db0fd4-132e-4053-8806-f0eea0fa40be admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:48.990488 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db0fd4-132e-4053-8806-f0eea0fa40be admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:49.068408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3a6cb-9f59-4415-92b8-37ad01c244bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:49.069103 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3a6cb-9f59-4415-92b8-37ad01c244bf admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:49.069384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3a6cb-9f59-4415-92b8-37ad01c244bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:49.069660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3a6cb-9f59-4415-92b8-37ad01c244bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:49.070423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3a6cb-9f59-4415-92b8-37ad01c244bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:49.072622 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3a6cb-9f59-4415-92b8-37ad01c244bf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:49.082641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1253/2482] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:48 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:49.086971 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b362d-020c-467e-87ac-e88ec6d92388 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:49.097365 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b362d-020c-467e-87ac-e88ec6d92388 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:49.101842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab002c-1b3d-4e3f-8a93-72191a86b8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:49.102740 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab002c-1b3d-4e3f-8a93-72191a86b8dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:49.103135 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab002c-1b3d-4e3f-8a93-72191a86b8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:49.103413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab002c-1b3d-4e3f-8a93-72191a86b8dc admin admin] PATH_INFO: `/v3/projects/c5b88faba2b349308e555cd33c33f621/users/ec7adef97edc4441be00e2da9e2b22a8/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:49.105368 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab002c-1b3d-4e3f-8a93-72191a86b8dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b88faba2b349308e555cd33c33f621, user_id=ec7adef97edc4441be00e2da9e2b22a8, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:49.108035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab002c-1b3d-4e3f-8a93-72191a86b8dc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:49.120823 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1230/2483] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:49 2021] PUT /identity/v3/projects/c5b88faba2b349308e555cd33c33f621/users/ec7adef97edc4441be00e2da9e2b22a8/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:49.130991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96474c1-cf6a-44bb-889f-94405c1a175b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:49.131275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96474c1-cf6a-44bb-889f-94405c1a175b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:49.131541 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96474c1-cf6a-44bb-889f-94405c1a175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:49.160946 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e96474c1-cf6a-44bb-889f-94405c1a175b None None] MFA Rules not processed for user `ec7adef97edc4441be00e2da9e2b22a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:49.162138 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e96474c1-cf6a-44bb-889f-94405c1a175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:49.231798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1254/2484] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:49 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:49.244694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab002c-1b3d-4e3f-8a93-72191a86b8dc admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:49.301809 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab002c-1b3d-4e3f-8a93-72191a86b8dc admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:49.308909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1b0f3-f5ba-4e3d-ad96-28a37a621313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:49.309339 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1b0f3-f5ba-4e3d-ad96-28a37a621313 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:49.309728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1b0f3-f5ba-4e3d-ad96-28a37a621313 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:49.310077 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1b0f3-f5ba-4e3d-ad96-28a37a621313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:49.321432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1b0f3-f5ba-4e3d-ad96-28a37a621313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:49.323674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1b0f3-f5ba-4e3d-ad96-28a37a621313 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:49.333549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1231/2485] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:49 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:49.653887 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96474c1-cf6a-44bb-889f-94405c1a175b None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:49.663047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96474c1-cf6a-44bb-889f-94405c1a175b None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:49.668533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4d48b-91bf-489e-844d-dd7a712326fe tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7adef97edc4441be00e2da9e2b22a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b88faba2b349308e555cd33c33f621', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:49.669186 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4d48b-91bf-489e-844d-dd7a712326fe tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:49.669472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4d48b-91bf-489e-844d-dd7a712326fe tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:49.669758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4d48b-91bf-489e-844d-dd7a712326fe tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:49.670533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4d48b-91bf-489e-844d-dd7a712326fe tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:13:49.670841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4d48b-91bf-489e-844d-dd7a712326fe tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:49.672430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4d48b-91bf-489e-844d-dd7a712326fe tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:49.684357 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1255/2486] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:13:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:13:49.689459 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1b0f3-f5ba-4e3d-ad96-28a37a621313 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:49.698909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1b0f3-f5ba-4e3d-ad96-28a37a621313 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:49.703614 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea79c52-575e-4084-ae4b-004ce0a23d81 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7adef97edc4441be00e2da9e2b22a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b88faba2b349308e555cd33c33f621', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:49.704327 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea79c52-575e-4084-ae4b-004ce0a23d81 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:49.704621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea79c52-575e-4084-ae4b-004ce0a23d81 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:49.704904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea79c52-575e-4084-ae4b-004ce0a23d81 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:49.705705 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea79c52-575e-4084-ae4b-004ce0a23d81 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:49.707755 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea79c52-575e-4084-ae4b-004ce0a23d81 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:49.735851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1232/2487] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:49 2021] POST /identity/v3/projects => generated 354 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:49.740246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4d48b-91bf-489e-844d-dd7a712326fe tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:49.750877 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4d48b-91bf-489e-844d-dd7a712326fe tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:49.809157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04d8fb-2a90-47ec-8275-db208759782f tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7adef97edc4441be00e2da9e2b22a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b88faba2b349308e555cd33c33f621', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:49.809949 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04d8fb-2a90-47ec-8275-db208759782f tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:49.810238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04d8fb-2a90-47ec-8275-db208759782f tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:49.810549 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04d8fb-2a90-47ec-8275-db208759782f tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:49.811286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04d8fb-2a90-47ec-8275-db208759782f tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:13:49.811600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04d8fb-2a90-47ec-8275-db208759782f tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:49.813193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04d8fb-2a90-47ec-8275-db208759782f tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:49.824616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1256/2488] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:13:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:13:49.861411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea79c52-575e-4084-ae4b-004ce0a23d81 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:49.871594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea79c52-575e-4084-ae4b-004ce0a23d81 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:49.876220 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c540d-9133-47b6-b38e-1998f30af139 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7adef97edc4441be00e2da9e2b22a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b88faba2b349308e555cd33c33f621', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:49.877056 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c540d-9133-47b6-b38e-1998f30af139 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:49.877369 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c540d-9133-47b6-b38e-1998f30af139 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:49.877649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c540d-9133-47b6-b38e-1998f30af139 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] PATH_INFO: `/v3/projects/8c927f7f53ab48f6984e79ec05afb196` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:49.878860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c540d-9133-47b6-b38e-1998f30af139 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8c927f7f53ab48f6984e79ec05afb196)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:49.880749 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c540d-9133-47b6-b38e-1998f30af139 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:49.925637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3d3c540d-9133-47b6-b38e-1998f30af139 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c927f7f53ab48f6984e79ec05afb196', 'request_id': 'req-3d3c540d-9133-47b6-b38e-1998f30af139'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:49.930900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3d3c540d-9133-47b6-b38e-1998f30af139 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c927f7f53ab48f6984e79ec05afb196', 'request_id': 'req-3d3c540d-9133-47b6-b38e-1998f30af139'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:49.936894 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3d3c540d-9133-47b6-b38e-1998f30af139 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c927f7f53ab48f6984e79ec05afb196', 'request_id': 'req-3d3c540d-9133-47b6-b38e-1998f30af139'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:49.948457 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3d3c540d-9133-47b6-b38e-1998f30af139 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] The token cache is being invalidate because project 8c927f7f53ab48f6984e79ec05afb196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:49.948737 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3d3c540d-9133-47b6-b38e-1998f30af139 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:49.949361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3d3c540d-9133-47b6-b38e-1998f30af139 tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:49.950931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1233/2489] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:13:49 2021] DELETE /identity/v3/projects/8c927f7f53ab48f6984e79ec05afb196 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:50.138765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04d8fb-2a90-47ec-8275-db208759782f tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:50.140485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0c04d8fb-2a90-47ec-8275-db208759782f tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:50.207217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04d8fb-2a90-47ec-8275-db208759782f tempest-VolumeQuotaClassesTest-1599285146 tempest-VolumeQuotaClassesTest-1599285146-project-admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:50.263288 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:50.264155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:50.264743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:50.265043 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] PATH_INFO: `/v3/users/3b1853f1825648c79af3f6842dd771fa` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:50.266326 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1853f1825648c79af3f6842dd771fa)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:50.268274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:50.319664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1853f1825648c79af3f6842dd771fa'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:50.319944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1853f1825648c79af3f6842dd771fa'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:50.328049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1853f1825648c79af3f6842dd771fa'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:50.329056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1853f1825648c79af3f6842dd771fa'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:50.342438 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1853f1825648c79af3f6842dd771fa'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:50.358392 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1257/2490] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:13:50 2021] DELETE /identity/v3/users/3b1853f1825648c79af3f6842dd771fa => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:50.362711 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcbd43-94b1-4d09-ad76-472b36b0f691 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:50.363000 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcbd43-94b1-4d09-ad76-472b36b0f691 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:50.363325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcbd43-94b1-4d09-ad76-472b36b0f691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:50.383130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d2fcbd43-94b1-4d09-ad76-472b36b0f691 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:50.384719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d2fcbd43-94b1-4d09-ad76-472b36b0f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:50.442765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1234/2491] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:50.453913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:50.455386 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:50.516525 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131192b-a1ea-49ef-bbbd-30578a7bc5bf admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:50.520194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cecf7-1920-4168-9e1d-c802d14cb77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:50.520844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cecf7-1920-4168-9e1d-c802d14cb77d service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:50.521124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cecf7-1920-4168-9e1d-c802d14cb77d service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:50.521398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cecf7-1920-4168-9e1d-c802d14cb77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:50.532272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cecf7-1920-4168-9e1d-c802d14cb77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:50.536311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cecf7-1920-4168-9e1d-c802d14cb77d service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:50.544396 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1258/2492] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:13:50.623402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcbd43-94b1-4d09-ad76-472b36b0f691 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:50.625112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d2fcbd43-94b1-4d09-ad76-472b36b0f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:50.648560 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcbd43-94b1-4d09-ad76-472b36b0f691 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:50.656939 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:50.657915 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:50.658273 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:50.658642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] PATH_INFO: `/v3/users/7b9f193140654d6b9e2efbae04524b57` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:50.660027 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9f193140654d6b9e2efbae04524b57)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:50.662222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:50.724196 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9f193140654d6b9e2efbae04524b57'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:50.732750 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9f193140654d6b9e2efbae04524b57'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:50.733582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9f193140654d6b9e2efbae04524b57'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:50.734278 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9f193140654d6b9e2efbae04524b57'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:50.748577 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9f193140654d6b9e2efbae04524b57'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:50.763441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1235/2493] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:13:50 2021] DELETE /identity/v3/users/7b9f193140654d6b9e2efbae04524b57 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:50.945625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cecf7-1920-4168-9e1d-c802d14cb77d service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:50.947182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-da6cecf7-1920-4168-9e1d-c802d14cb77d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:50.964654 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cecf7-1920-4168-9e1d-c802d14cb77d service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:51.003042 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:51.004955 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:51.039149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:51.040039 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:51.040853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:51.041344 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] PATH_INFO: `/v3/projects/171ee2374ad945babd3393a80eb1474e` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:51.042519 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] RBAC: Authorizing `identity:delete_project(project_id=171ee2374ad945babd3393a80eb1474e)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:51.044509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:51.072467 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d88dd-cfcc-4dc6-8453-2a9a832092e7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:51.077231 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:51.078108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:51.078416 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:51.078697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] PATH_INFO: `/v3/projects/a00edc9fc6a744efa5c33e63db2a7eb2` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:51.079891 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00edc9fc6a744efa5c33e63db2a7eb2)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:51.081791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:51.091308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171ee2374ad945babd3393a80eb1474e', 'request_id': 'req-6c520a91-6225-4e19-8860-260c757b95df'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.097457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171ee2374ad945babd3393a80eb1474e', 'request_id': 'req-6c520a91-6225-4e19-8860-260c757b95df'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.105493 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171ee2374ad945babd3393a80eb1474e', 'request_id': 'req-6c520a91-6225-4e19-8860-260c757b95df'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.115981 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] The token cache is being invalidate because project 171ee2374ad945babd3393a80eb1474e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:51.116271 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.116896 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.119068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1259/2494] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:13:50 2021] DELETE /identity/v3/projects/171ee2374ad945babd3393a80eb1474e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:51.123327 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:51.124732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:51.128808 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'request_id': 'req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.133964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'request_id': 'req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.139959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'request_id': 'req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.153551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] The token cache is being invalidate because project a00edc9fc6a744efa5c33e63db2a7eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:51.153828 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.154552 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.156326 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1236/2495] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:13:51 2021] DELETE /identity/v3/projects/a00edc9fc6a744efa5c33e63db2a7eb2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:13:51.192477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c520a91-6225-4e19-8860-260c757b95df admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:51.254177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d94deb-ad72-470b-956c-34002086fa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:51.255098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d94deb-ad72-470b-956c-34002086fa67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:51.255382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d94deb-ad72-470b-956c-34002086fa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:51.255655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d94deb-ad72-470b-956c-34002086fa67 admin admin] PATH_INFO: `/v3/users/ec7adef97edc4441be00e2da9e2b22a8` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:51.256959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d94deb-ad72-470b-956c-34002086fa67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec7adef97edc4441be00e2da9e2b22a8)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:51.259348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d94deb-ad72-470b-956c-34002086fa67 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:51.312429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-33d94deb-ad72-470b-956c-34002086fa67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec7adef97edc4441be00e2da9e2b22a8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.313115 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-33d94deb-ad72-470b-956c-34002086fa67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec7adef97edc4441be00e2da9e2b22a8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.320138 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-33d94deb-ad72-470b-956c-34002086fa67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec7adef97edc4441be00e2da9e2b22a8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.320876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-33d94deb-ad72-470b-956c-34002086fa67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec7adef97edc4441be00e2da9e2b22a8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.332784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-33d94deb-ad72-470b-956c-34002086fa67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec7adef97edc4441be00e2da9e2b22a8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.346278 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1260/2496] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:13:51 2021] DELETE /identity/v3/users/ec7adef97edc4441be00e2da9e2b22a8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:51.611353 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:51.612926 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:51.631403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb348ca-0ebd-40b8-bc0c-a0f251e793e6 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:51.687605 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:51.688450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:51.688727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:51.689016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab admin admin] PATH_INFO: `/v3/projects/c5b88faba2b349308e555cd33c33f621` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:51.690183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b88faba2b349308e555cd33c33f621)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:51.692125 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:51.740808 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b88faba2b349308e555cd33c33f621', 'request_id': 'req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.746112 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b88faba2b349308e555cd33c33f621', 'request_id': 'req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.752819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b88faba2b349308e555cd33c33f621', 'request_id': 'req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.765035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab admin admin] The token cache is being invalidate because project c5b88faba2b349308e555cd33c33f621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:51.765319 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.765926 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-43c6d5d5-b3a3-4a7f-abf7-0e041f68b7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:51.767480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1237/2497] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:13:51 2021] DELETE /identity/v3/projects/c5b88faba2b349308e555cd33c33f621 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:51.773125 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f321ec-55df-433a-a7c2-65b26eb23d24 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:51.773410 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f321ec-55df-433a-a7c2-65b26eb23d24 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:51.773690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f321ec-55df-433a-a7c2-65b26eb23d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:51.791784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-c8f321ec-55df-433a-a7c2-65b26eb23d24 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:51.793012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c8f321ec-55df-433a-a7c2-65b26eb23d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:51.854782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1261/2498] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:51.862782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f720-385e-4a62-9831-c6c2b21a454a None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:51.863094 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f720-385e-4a62-9831-c6c2b21a454a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:51.863374 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f720-385e-4a62-9831-c6c2b21a454a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:51.881759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-d8f8f720-385e-4a62-9831-c6c2b21a454a None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:51.883012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d8f8f720-385e-4a62-9831-c6c2b21a454a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:51.891503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1238/2499] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:51.895777 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f321ec-55df-433a-a7c2-65b26eb23d24 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:51.906391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f321ec-55df-433a-a7c2-65b26eb23d24 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:51.911139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d99ec-858c-48ad-9403-3f5659f2a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:51.911791 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d99ec-858c-48ad-9403-3f5659f2a98e admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:51.912075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d99ec-858c-48ad-9403-3f5659f2a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:51.912493 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d99ec-858c-48ad-9403-3f5659f2a98e admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:51.913082 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d99ec-858c-48ad-9403-3f5659f2a98e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:13:51.913390 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d99ec-858c-48ad-9403-3f5659f2a98e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:51.915023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d99ec-858c-48ad-9403-3f5659f2a98e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:51.934451 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1262/2500] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:13:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:13:51.938183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f720-385e-4a62-9831-c6c2b21a454a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:51.948461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f720-385e-4a62-9831-c6c2b21a454a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:51.953117 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ff44d-19ed-440b-b3d1-6fd17118aaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:51.953766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ff44d-19ed-440b-b3d1-6fd17118aaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:51.954051 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ff44d-19ed-440b-b3d1-6fd17118aaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:51.954326 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ff44d-19ed-440b-b3d1-6fd17118aaf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:51.955087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ff44d-19ed-440b-b3d1-6fd17118aaf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:51.956995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ff44d-19ed-440b-b3d1-6fd17118aaf3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:51.985938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1239/2501] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:51 2021] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:51.987386 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d99ec-858c-48ad-9403-3f5659f2a98e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:51.998190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d99ec-858c-48ad-9403-3f5659f2a98e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:52.053034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b3bd9-87a1-431d-92e2-8b6d068628a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:52.053704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b3bd9-87a1-431d-92e2-8b6d068628a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.053990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b3bd9-87a1-431d-92e2-8b6d068628a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.054260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b3bd9-87a1-431d-92e2-8b6d068628a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.054993 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b3bd9-87a1-431d-92e2-8b6d068628a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:52.057702 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b3bd9-87a1-431d-92e2-8b6d068628a9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:52.076675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1263/2502] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:13:51 2021] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:52.080594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ff44d-19ed-440b-b3d1-6fd17118aaf3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:52.091496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ff44d-19ed-440b-b3d1-6fd17118aaf3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:52.096489 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6febdd-d520-437c-a83b-ed25a60d047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:52.097189 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6febdd-d520-437c-a83b-ed25a60d047e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.097419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6febdd-d520-437c-a83b-ed25a60d047e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.097734 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6febdd-d520-437c-a83b-ed25a60d047e admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.098599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6febdd-d520-437c-a83b-ed25a60d047e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:52.100200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6febdd-d520-437c-a83b-ed25a60d047e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:52.111424 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1240/2503] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:52.115420 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b3bd9-87a1-431d-92e2-8b6d068628a9 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:52.125718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b3bd9-87a1-431d-92e2-8b6d068628a9 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:52.130313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506aa5d3-f32c-474d-abc5-3a442c520461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:52.130997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aa5d3-f32c-474d-abc5-3a442c520461 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.131280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aa5d3-f32c-474d-abc5-3a442c520461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.131555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aa5d3-f32c-474d-abc5-3a442c520461 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.132283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aa5d3-f32c-474d-abc5-3a442c520461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:52.133864 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aa5d3-f32c-474d-abc5-3a442c520461 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:52.143771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1264/2504] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:52.147759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6febdd-d520-437c-a83b-ed25a60d047e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:52.158480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6febdd-d520-437c-a83b-ed25a60d047e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:52.163068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68595979-9250-45ed-a32d-226da1339c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:52.163963 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68595979-9250-45ed-a32d-226da1339c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.164246 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68595979-9250-45ed-a32d-226da1339c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.164523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68595979-9250-45ed-a32d-226da1339c50 admin admin] PATH_INFO: `/v3/projects/e5aaee72c0154d8294d432d0e174906b/users/c387d707bd3b496ba5e636850c8f5b5e/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.183275 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68595979-9250-45ed-a32d-226da1339c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5aaee72c0154d8294d432d0e174906b, user_id=c387d707bd3b496ba5e636850c8f5b5e, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:52.185937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68595979-9250-45ed-a32d-226da1339c50 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:52.198358 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1241/2505] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:52 2021] PUT /identity/v3/projects/e5aaee72c0154d8294d432d0e174906b/users/c387d707bd3b496ba5e636850c8f5b5e/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:52.209246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efebb11-c4d4-4fbe-9e9b-3f56d99027a6 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.209767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efebb11-c4d4-4fbe-9e9b-3f56d99027a6 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.209868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efebb11-c4d4-4fbe-9e9b-3f56d99027a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.236714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-5efebb11-c4d4-4fbe-9e9b-3f56d99027a6 None None] MFA Rules not processed for user `c387d707bd3b496ba5e636850c8f5b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:52.237921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5efebb11-c4d4-4fbe-9e9b-3f56d99027a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:52.301072 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1265/2506] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:52 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:52.305570 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68595979-9250-45ed-a32d-226da1339c50 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:52.368202 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68595979-9250-45ed-a32d-226da1339c50 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:52.373390 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3200fe-92b7-45bb-a06b-2ffca3d9af75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:52.374029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3200fe-92b7-45bb-a06b-2ffca3d9af75 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.374309 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3200fe-92b7-45bb-a06b-2ffca3d9af75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.374613 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3200fe-92b7-45bb-a06b-2ffca3d9af75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.375301 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3200fe-92b7-45bb-a06b-2ffca3d9af75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:52.377178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3200fe-92b7-45bb-a06b-2ffca3d9af75 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:52.402126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1242/2507] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:52 2021] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:52.406131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efebb11-c4d4-4fbe-9e9b-3f56d99027a6 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:52.417251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efebb11-c4d4-4fbe-9e9b-3f56d99027a6 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:52.470653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be471abf-4352-4961-9a05-b1909e156d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:52.471314 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be471abf-4352-4961-9a05-b1909e156d14 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.471597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be471abf-4352-4961-9a05-b1909e156d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.471891 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be471abf-4352-4961-9a05-b1909e156d14 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.472588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be471abf-4352-4961-9a05-b1909e156d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:52.474513 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be471abf-4352-4961-9a05-b1909e156d14 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:52.495403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1266/2508] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:13:52 2021] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:13:52.499243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3200fe-92b7-45bb-a06b-2ffca3d9af75 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:52.509843 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3200fe-92b7-45bb-a06b-2ffca3d9af75 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:52.514565 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb0907-227f-44fe-a173-b63c9b29eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:52.515221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb0907-227f-44fe-a173-b63c9b29eca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.515506 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb0907-227f-44fe-a173-b63c9b29eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.515783 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb0907-227f-44fe-a173-b63c9b29eca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.516520 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb0907-227f-44fe-a173-b63c9b29eca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:52.518101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb0907-227f-44fe-a173-b63c9b29eca3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:52.529311 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1243/2509] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:52.533611 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be471abf-4352-4961-9a05-b1909e156d14 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:52.544793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be471abf-4352-4961-9a05-b1909e156d14 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:52.549462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37027b44-efc7-4ffb-9bc3-46e204fb03dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:52.550346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37027b44-efc7-4ffb-9bc3-46e204fb03dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.550655 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37027b44-efc7-4ffb-9bc3-46e204fb03dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.550937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37027b44-efc7-4ffb-9bc3-46e204fb03dd admin admin] PATH_INFO: `/v3/projects/f63b99db4a7c470299f4846309b9015d/users/e0cebd5105954ba5883ea327f67f02af/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.566762 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37027b44-efc7-4ffb-9bc3-46e204fb03dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63b99db4a7c470299f4846309b9015d, user_id=e0cebd5105954ba5883ea327f67f02af, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:52.569400 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37027b44-efc7-4ffb-9bc3-46e204fb03dd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:52.582168 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1267/2510] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:52 2021] PUT /identity/v3/projects/f63b99db4a7c470299f4846309b9015d/users/e0cebd5105954ba5883ea327f67f02af/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:52.586029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb0907-227f-44fe-a173-b63c9b29eca3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:52.596167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb0907-227f-44fe-a173-b63c9b29eca3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:52.650670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97aaac-635f-4254-9055-6e3f90426e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:52.651336 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97aaac-635f-4254-9055-6e3f90426e78 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.651621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97aaac-635f-4254-9055-6e3f90426e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.651900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97aaac-635f-4254-9055-6e3f90426e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.652713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97aaac-635f-4254-9055-6e3f90426e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:52.655330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97aaac-635f-4254-9055-6e3f90426e78 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:52.668374 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1244/2511] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:52 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:52.672386 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37027b44-efc7-4ffb-9bc3-46e204fb03dd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:52.683755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37027b44-efc7-4ffb-9bc3-46e204fb03dd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:52.689871 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8900a75-fa1c-4f19-8350-1a3825674fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:52.690793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8900a75-fa1c-4f19-8350-1a3825674fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.691082 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8900a75-fa1c-4f19-8350-1a3825674fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.691363 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8900a75-fa1c-4f19-8350-1a3825674fb0 admin admin] PATH_INFO: `/v3/projects/f63b99db4a7c470299f4846309b9015d/users/e0cebd5105954ba5883ea327f67f02af/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.693358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8900a75-fa1c-4f19-8350-1a3825674fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63b99db4a7c470299f4846309b9015d, user_id=e0cebd5105954ba5883ea327f67f02af, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:52.696122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8900a75-fa1c-4f19-8350-1a3825674fb0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:52.706527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1268/2512] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:52 2021] PUT /identity/v3/projects/f63b99db4a7c470299f4846309b9015d/users/e0cebd5105954ba5883ea327f67f02af/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:52.717564 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a36933-f08f-4e2e-b066-fd62df469ff3 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.717853 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a36933-f08f-4e2e-b066-fd62df469ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.718130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a36933-f08f-4e2e-b066-fd62df469ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.744415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-34a36933-f08f-4e2e-b066-fd62df469ff3 None None] MFA Rules not processed for user `e0cebd5105954ba5883ea327f67f02af`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:52.745597 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-34a36933-f08f-4e2e-b066-fd62df469ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:52.811596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1245/2513] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:52 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:13:52.822850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8900a75-fa1c-4f19-8350-1a3825674fb0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:52.824549 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d8900a75-fa1c-4f19-8350-1a3825674fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:52.880971 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8900a75-fa1c-4f19-8350-1a3825674fb0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:52.884671 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bce41-5cf6-43bf-8d58-6f366bdc7006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:52.885300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bce41-5cf6-43bf-8d58-6f366bdc7006 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:52.885578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bce41-5cf6-43bf-8d58-6f366bdc7006 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:52.885852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bce41-5cf6-43bf-8d58-6f366bdc7006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:52.894472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bce41-5cf6-43bf-8d58-6f366bdc7006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:52.895884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bce41-5cf6-43bf-8d58-6f366bdc7006 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:52.905582 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1269/2514] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:52 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:53.304479 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a36933-f08f-4e2e-b066-fd62df469ff3 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:53.372607 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a36933-f08f-4e2e-b066-fd62df469ff3 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:53.377442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:53.378325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:53.378637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:53.378917 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] PATH_INFO: `/v3/users/c387d707bd3b496ba5e636850c8f5b5e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:53.383008 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c387d707bd3b496ba5e636850c8f5b5e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:53.384495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:53.457911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c387d707bd3b496ba5e636850c8f5b5e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:53.468886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c387d707bd3b496ba5e636850c8f5b5e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:53.469618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c387d707bd3b496ba5e636850c8f5b5e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:53.471192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c387d707bd3b496ba5e636850c8f5b5e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:53.483347 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c387d707bd3b496ba5e636850c8f5b5e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:53.498967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1246/2515] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:13:53 2021] DELETE /identity/v3/users/c387d707bd3b496ba5e636850c8f5b5e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:53.503828 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48c862-0e7b-4a02-bae0-aab5709bc64f None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:53.504317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48c862-0e7b-4a02-bae0-aab5709bc64f None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:53.504419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48c862-0e7b-4a02-bae0-aab5709bc64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:53.522702 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ca48c862-0e7b-4a02-bae0-aab5709bc64f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:53.523933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ca48c862-0e7b-4a02-bae0-aab5709bc64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:53.591444 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1270/2516] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:13:53.602108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:53.604376 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:53.664734 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145f925-b043-4441-a3b4-f550d8fe494e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:53.668146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab50f51-f6b7-4437-a509-8338cd0a82f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:53.668795 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab50f51-f6b7-4437-a509-8338cd0a82f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:53.669094 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab50f51-f6b7-4437-a509-8338cd0a82f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:53.669357 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab50f51-f6b7-4437-a509-8338cd0a82f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:53.678709 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab50f51-f6b7-4437-a509-8338cd0a82f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:53.680141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab50f51-f6b7-4437-a509-8338cd0a82f3 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:53.690624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1247/2517] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:53.969213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48c862-0e7b-4a02-bae0-aab5709bc64f None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:53.970875 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ca48c862-0e7b-4a02-bae0-aab5709bc64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:53.987048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48c862-0e7b-4a02-bae0-aab5709bc64f None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:53.992816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53423284-dc2f-4095-a4e7-ac5accd0bf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:53.995318 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53423284-dc2f-4095-a4e7-ac5accd0bf15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:53.995718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53423284-dc2f-4095-a4e7-ac5accd0bf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:53.996126 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53423284-dc2f-4095-a4e7-ac5accd0bf15 admin admin] PATH_INFO: `/v3/projects/e5aaee72c0154d8294d432d0e174906b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:53.997805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53423284-dc2f-4095-a4e7-ac5accd0bf15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5aaee72c0154d8294d432d0e174906b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:54.000489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53423284-dc2f-4095-a4e7-ac5accd0bf15 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:54.050767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-53423284-dc2f-4095-a4e7-ac5accd0bf15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5aaee72c0154d8294d432d0e174906b', 'request_id': 'req-53423284-dc2f-4095-a4e7-ac5accd0bf15'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.058647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-53423284-dc2f-4095-a4e7-ac5accd0bf15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5aaee72c0154d8294d432d0e174906b', 'request_id': 'req-53423284-dc2f-4095-a4e7-ac5accd0bf15'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.066635 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-53423284-dc2f-4095-a4e7-ac5accd0bf15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5aaee72c0154d8294d432d0e174906b', 'request_id': 'req-53423284-dc2f-4095-a4e7-ac5accd0bf15'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.078196 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-53423284-dc2f-4095-a4e7-ac5accd0bf15 admin admin] The token cache is being invalidate because project e5aaee72c0154d8294d432d0e174906b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:54.078523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-53423284-dc2f-4095-a4e7-ac5accd0bf15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.079363 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-53423284-dc2f-4095-a4e7-ac5accd0bf15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.081175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1271/2518] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:13:53 2021] DELETE /identity/v3/projects/e5aaee72c0154d8294d432d0e174906b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:54.084937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab50f51-f6b7-4437-a509-8338cd0a82f3 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:54.097329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab50f51-f6b7-4437-a509-8338cd0a82f3 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:54.155762 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:54.156638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:54.156925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:54.157209 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] PATH_INFO: `/v3/users/e0cebd5105954ba5883ea327f67f02af` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:54.158439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0cebd5105954ba5883ea327f67f02af)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:54.160365 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:54.206388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0cebd5105954ba5883ea327f67f02af'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.213691 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0cebd5105954ba5883ea327f67f02af'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.214652 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0cebd5105954ba5883ea327f67f02af'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.215267 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0cebd5105954ba5883ea327f67f02af'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.226583 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0cebd5105954ba5883ea327f67f02af'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.239873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1248/2519] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:13:54 2021] DELETE /identity/v3/users/e0cebd5105954ba5883ea327f67f02af => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:54.359727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d5716-be56-4022-a727-45f0db1f79b4 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:54.360033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d5716-be56-4022-a727-45f0db1f79b4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:54.360995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d5716-be56-4022-a727-45f0db1f79b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:54.427717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-fd7d5716-be56-4022-a727-45f0db1f79b4 None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:54.428937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fd7d5716-be56-4022-a727-45f0db1f79b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:54.529875 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1272/2520] 10.222.0.23 () {58 vars in 967 bytes} [Thu Dec 9 01:13:54 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:13:54.534697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:54.536584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:54.601529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d5716-be56-4022-a727-45f0db1f79b4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:54.603484 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fd7d5716-be56-4022-a727-45f0db1f79b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:54.635927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eddb0-e594-41c5-800c-cb1549ecd465 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:54.641045 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:54.642024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:54.642540 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:54.642904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3 admin admin] PATH_INFO: `/v3/projects/f63b99db4a7c470299f4846309b9015d` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:54.644285 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63b99db4a7c470299f4846309b9015d)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:54.647072 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:54.694959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63b99db4a7c470299f4846309b9015d', 'request_id': 'req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.697853 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d5716-be56-4022-a727-45f0db1f79b4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:54.701981 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63b99db4a7c470299f4846309b9015d', 'request_id': 'req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.708896 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63b99db4a7c470299f4846309b9015d', 'request_id': 'req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.722212 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3 admin admin] The token cache is being invalidate because project f63b99db4a7c470299f4846309b9015d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:13:54.723027 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.723320 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-ae49a6f8-b361-4b2e-90b1-39f9f47650d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:13:54.725087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1249/2521] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:13:54 2021] DELETE /identity/v3/projects/f63b99db4a7c470299f4846309b9015d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:54.732095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f235304-75c7-4673-a511-be5e3958d822 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:54.732404 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f235304-75c7-4673-a511-be5e3958d822 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:54.732633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f235304-75c7-4673-a511-be5e3958d822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:54.751574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-1f235304-75c7-4673-a511-be5e3958d822 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:54.752776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-1f235304-75c7-4673-a511-be5e3958d822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:54.766532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcc248-fbff-4e1c-977c-0717b506736e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:54.767178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc248-fbff-4e1c-977c-0717b506736e service swift] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:54.767458 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc248-fbff-4e1c-977c-0717b506736e service swift] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:54.767743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc248-fbff-4e1c-977c-0717b506736e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:54.769521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ccdcc248-fbff-4e1c-977c-0717b506736e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:54.814310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1250/2522] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:13:54.822009 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756ec77-86e2-40ce-a4eb-cbda16a6fbef None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:54.822404 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756ec77-86e2-40ce-a4eb-cbda16a6fbef None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:54.822782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756ec77-86e2-40ce-a4eb-cbda16a6fbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:54.838042 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcc248-fbff-4e1c-977c-0717b506736e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:54.840016 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcc248-fbff-4e1c-977c-0717b506736e service swift] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:54.844642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-a756ec77-86e2-40ce-a4eb-cbda16a6fbef None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:54.845934 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a756ec77-86e2-40ce-a4eb-cbda16a6fbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:54.849715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1273/2523] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:13:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 09 01:13:54.856530 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1251/2524] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:13:54.860465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcc248-fbff-4e1c-977c-0717b506736e service swift] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:54.871147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcc248-fbff-4e1c-977c-0717b506736e service swift] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:54.875875 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59222a97-5614-4c0b-b00c-698c51881630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:54.876734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59222a97-5614-4c0b-b00c-698c51881630 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:54.877020 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59222a97-5614-4c0b-b00c-698c51881630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:54.877299 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59222a97-5614-4c0b-b00c-698c51881630 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:54.878033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59222a97-5614-4c0b-b00c-698c51881630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:13:54.878345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59222a97-5614-4c0b-b00c-698c51881630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:54.880019 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59222a97-5614-4c0b-b00c-698c51881630 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:54.892719 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1274/2525] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:13:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:13:54.897098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756ec77-86e2-40ce-a4eb-cbda16a6fbef None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:54.909003 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756ec77-86e2-40ce-a4eb-cbda16a6fbef None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:54.921447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fb48b-f893-47b3-a014-6369322378bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:54.923182 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fb48b-f893-47b3-a014-6369322378bf admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:54.923537 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fb48b-f893-47b3-a014-6369322378bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:54.924071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fb48b-f893-47b3-a014-6369322378bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:54.924855 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fb48b-f893-47b3-a014-6369322378bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:54.927172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fb48b-f893-47b3-a014-6369322378bf admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:54.957700 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1252/2526] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:54 2021] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:54.961707 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59222a97-5614-4c0b-b00c-698c51881630 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:54.972641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59222a97-5614-4c0b-b00c-698c51881630 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:55.039668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec15773-3ff2-42a3-8039-a2ff20ada4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:55.040520 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec15773-3ff2-42a3-8039-a2ff20ada4be admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:55.040881 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec15773-3ff2-42a3-8039-a2ff20ada4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:55.041127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec15773-3ff2-42a3-8039-a2ff20ada4be admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:55.041884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec15773-3ff2-42a3-8039-a2ff20ada4be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:55.043918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec15773-3ff2-42a3-8039-a2ff20ada4be admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:55.065568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1275/2527] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:13:54 2021] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:55.069828 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fb48b-f893-47b3-a014-6369322378bf admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:55.080857 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fb48b-f893-47b3-a014-6369322378bf admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:55.085940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3ff76-5c7c-4bea-a7b9-551013309861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:55.086598 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3ff76-5c7c-4bea-a7b9-551013309861 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:55.086887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3ff76-5c7c-4bea-a7b9-551013309861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:55.087211 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3ff76-5c7c-4bea-a7b9-551013309861 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:55.088069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3ff76-5c7c-4bea-a7b9-551013309861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:55.089941 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3ff76-5c7c-4bea-a7b9-551013309861 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:55.105674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1253/2528] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:55 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:55.107082 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec15773-3ff2-42a3-8039-a2ff20ada4be admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:55.117200 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec15773-3ff2-42a3-8039-a2ff20ada4be admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:55.123224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a745970-43d7-4588-9745-c1fe44a2aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:55.123884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a745970-43d7-4588-9745-c1fe44a2aaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:55.124166 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a745970-43d7-4588-9745-c1fe44a2aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:55.124446 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a745970-43d7-4588-9745-c1fe44a2aaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:55.125190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a745970-43d7-4588-9745-c1fe44a2aaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:55.126829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a745970-43d7-4588-9745-c1fe44a2aaf8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:55.138321 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1276/2529] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:55.142728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3ff76-5c7c-4bea-a7b9-551013309861 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:55.153149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3ff76-5c7c-4bea-a7b9-551013309861 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:55.157957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e648878-5d17-4d6d-bfc7-7f5df16831dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:55.158997 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e648878-5d17-4d6d-bfc7-7f5df16831dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:55.159494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e648878-5d17-4d6d-bfc7-7f5df16831dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:55.159899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e648878-5d17-4d6d-bfc7-7f5df16831dd admin admin] PATH_INFO: `/v3/projects/98af4aafd383400585148f49714381be/users/e37f2110e1ec47d9a0c527eae0affe51/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:55.176395 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e648878-5d17-4d6d-bfc7-7f5df16831dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=98af4aafd383400585148f49714381be, user_id=e37f2110e1ec47d9a0c527eae0affe51, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:55.179084 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e648878-5d17-4d6d-bfc7-7f5df16831dd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:55.193349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1254/2530] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:55 2021] PUT /identity/v3/projects/98af4aafd383400585148f49714381be/users/e37f2110e1ec47d9a0c527eae0affe51/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:13:55.205164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b38e4-1af5-456c-9259-6e3da51ff99c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:55.205457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b38e4-1af5-456c-9259-6e3da51ff99c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:55.205741 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b38e4-1af5-456c-9259-6e3da51ff99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:55.234464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-f67b38e4-1af5-456c-9259-6e3da51ff99c None None] MFA Rules not processed for user `e37f2110e1ec47d9a0c527eae0affe51`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:55.235957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f67b38e4-1af5-456c-9259-6e3da51ff99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:55.315065 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1277/2531] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:55 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:55.316196 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e648878-5d17-4d6d-bfc7-7f5df16831dd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:55.378842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e648878-5d17-4d6d-bfc7-7f5df16831dd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:55.383955 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818521b-a8fa-45e7-a2c3-3a5ee3a8e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:55.384610 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818521b-a8fa-45e7-a2c3-3a5ee3a8e855 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:55.384888 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818521b-a8fa-45e7-a2c3-3a5ee3a8e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:55.385584 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818521b-a8fa-45e7-a2c3-3a5ee3a8e855 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:55.385864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818521b-a8fa-45e7-a2c3-3a5ee3a8e855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:55.387785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818521b-a8fa-45e7-a2c3-3a5ee3a8e855 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:55.414757 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1255/2532] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:55 2021] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:55.419131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b38e4-1af5-456c-9259-6e3da51ff99c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:55.429829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b38e4-1af5-456c-9259-6e3da51ff99c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:55.490208 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9db43-1f4b-4bd5-9399-388990398a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:55.491012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9db43-1f4b-4bd5-9399-388990398a12 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:55.491376 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9db43-1f4b-4bd5-9399-388990398a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:55.491719 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9db43-1f4b-4bd5-9399-388990398a12 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:55.492495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9db43-1f4b-4bd5-9399-388990398a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:55.494569 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9db43-1f4b-4bd5-9399-388990398a12 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:55.518805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1278/2533] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:13:55 2021] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:55.523051 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818521b-a8fa-45e7-a2c3-3a5ee3a8e855 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:55.538596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818521b-a8fa-45e7-a2c3-3a5ee3a8e855 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:55.545934 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abbd5d-8fd2-4507-b97f-1284a8324ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:55.547308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abbd5d-8fd2-4507-b97f-1284a8324ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:55.547775 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abbd5d-8fd2-4507-b97f-1284a8324ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:55.548205 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abbd5d-8fd2-4507-b97f-1284a8324ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:55.549142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abbd5d-8fd2-4507-b97f-1284a8324ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:55.551554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abbd5d-8fd2-4507-b97f-1284a8324ba3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:55.566355 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1256/2534] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:55 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:55.570756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9db43-1f4b-4bd5-9399-388990398a12 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:55.582955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9db43-1f4b-4bd5-9399-388990398a12 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:55.590729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fe502-c347-4b38-80d7-e5389b217db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:55.591677 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fe502-c347-4b38-80d7-e5389b217db8 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:55.592138 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fe502-c347-4b38-80d7-e5389b217db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:55.592594 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fe502-c347-4b38-80d7-e5389b217db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:55.594358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fe502-c347-4b38-80d7-e5389b217db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:55.596952 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fe502-c347-4b38-80d7-e5389b217db8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:55.610188 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1279/2535] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:55 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:13:55.615041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abbd5d-8fd2-4507-b97f-1284a8324ba3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:55.629153 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abbd5d-8fd2-4507-b97f-1284a8324ba3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:55.635049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5ee06-87c5-4598-b112-bbb5a0339531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:55.636142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5ee06-87c5-4598-b112-bbb5a0339531 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:55.636422 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5ee06-87c5-4598-b112-bbb5a0339531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:55.636696 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5ee06-87c5-4598-b112-bbb5a0339531 admin admin] PATH_INFO: `/v3/projects/759def84ff0e4eb8a8ecdf648665db7a/users/9813928a77ee4dcb9ebe8acb10739f6b/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:55.658017 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5ee06-87c5-4598-b112-bbb5a0339531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759def84ff0e4eb8a8ecdf648665db7a, user_id=9813928a77ee4dcb9ebe8acb10739f6b, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:55.661977 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5ee06-87c5-4598-b112-bbb5a0339531 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:55.678866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1257/2536] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:55 2021] PUT /identity/v3/projects/759def84ff0e4eb8a8ecdf648665db7a/users/9813928a77ee4dcb9ebe8acb10739f6b/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:55.691416 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930c787-3b1f-4d9f-ad55-dd653454b9da None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:55.691774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930c787-3b1f-4d9f-ad55-dd653454b9da None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:55.692131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930c787-3b1f-4d9f-ad55-dd653454b9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:55.721623 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2930c787-3b1f-4d9f-ad55-dd653454b9da None None] MFA Rules not processed for user `9813928a77ee4dcb9ebe8acb10739f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:55.723221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2930c787-3b1f-4d9f-ad55-dd653454b9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:55.804788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1280/2537] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:55 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:55.809877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5ee06-87c5-4598-b112-bbb5a0339531 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:55.880515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5ee06-87c5-4598-b112-bbb5a0339531 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:55.886217 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4e135-db4d-48f5-b0a7-f90dca19ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:55.886969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4e135-db4d-48f5-b0a7-f90dca19ca45 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:55.887341 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4e135-db4d-48f5-b0a7-f90dca19ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:55.887683 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4e135-db4d-48f5-b0a7-f90dca19ca45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:55.888483 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4e135-db4d-48f5-b0a7-f90dca19ca45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:55.890859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4e135-db4d-48f5-b0a7-f90dca19ca45 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:55.922647 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1258/2538] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:13:55 2021] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:55.923911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930c787-3b1f-4d9f-ad55-dd653454b9da None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:55.942268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930c787-3b1f-4d9f-ad55-dd653454b9da None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:56.018467 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480be32-124e-46e5-8d0f-20bebab0a5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:56.019142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480be32-124e-46e5-8d0f-20bebab0a5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:56.019428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480be32-124e-46e5-8d0f-20bebab0a5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:56.019710 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480be32-124e-46e5-8d0f-20bebab0a5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:56.020412 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480be32-124e-46e5-8d0f-20bebab0a5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:56.022330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480be32-124e-46e5-8d0f-20bebab0a5a2 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:56.046316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1281/2539] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:13:55 2021] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:13:56.047904 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4e135-db4d-48f5-b0a7-f90dca19ca45 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:56.059658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4e135-db4d-48f5-b0a7-f90dca19ca45 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:56.064440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8737e-9868-4668-8f07-f611fd85a937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:56.065241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8737e-9868-4668-8f07-f611fd85a937 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:56.065534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8737e-9868-4668-8f07-f611fd85a937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:56.065814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8737e-9868-4668-8f07-f611fd85a937 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:56.066576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8737e-9868-4668-8f07-f611fd85a937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:56.068163 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8737e-9868-4668-8f07-f611fd85a937 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:56.079581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1259/2540] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:56 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:56.083615 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480be32-124e-46e5-8d0f-20bebab0a5a2 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:56.093797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480be32-124e-46e5-8d0f-20bebab0a5a2 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:56.098489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb524c1-3f11-441c-8938-196be72d44b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:56.099365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb524c1-3f11-441c-8938-196be72d44b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:56.099648 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb524c1-3f11-441c-8938-196be72d44b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:56.099926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb524c1-3f11-441c-8938-196be72d44b4 admin admin] PATH_INFO: `/v3/projects/dd2de7f457ca46488adfd23f67548802/users/fc092b8719264e7185893637b70ead99/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:56.114996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb524c1-3f11-441c-8938-196be72d44b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2de7f457ca46488adfd23f67548802, user_id=fc092b8719264e7185893637b70ead99, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:56.117642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb524c1-3f11-441c-8938-196be72d44b4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:56.135905 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1282/2541] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:56 2021] PUT /identity/v3/projects/dd2de7f457ca46488adfd23f67548802/users/fc092b8719264e7185893637b70ead99/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:13:56.137571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8737e-9868-4668-8f07-f611fd85a937 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:56.148464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8737e-9868-4668-8f07-f611fd85a937 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:56.205655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed121f2-982a-4f70-a8f9-a9fd7d64ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:56.206325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed121f2-982a-4f70-a8f9-a9fd7d64ba06 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:56.206655 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed121f2-982a-4f70-a8f9-a9fd7d64ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:56.206928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed121f2-982a-4f70-a8f9-a9fd7d64ba06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:56.207694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed121f2-982a-4f70-a8f9-a9fd7d64ba06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:56.209329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed121f2-982a-4f70-a8f9-a9fd7d64ba06 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:56.220889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1260/2542] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:13:56 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:13:56.225064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb524c1-3f11-441c-8938-196be72d44b4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:56.235874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb524c1-3f11-441c-8938-196be72d44b4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:56.241193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdbdce-5fd3-4da3-bca8-72378ad0d277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:56.242075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdbdce-5fd3-4da3-bca8-72378ad0d277 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:56.242356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdbdce-5fd3-4da3-bca8-72378ad0d277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:56.242659 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdbdce-5fd3-4da3-bca8-72378ad0d277 admin admin] PATH_INFO: `/v3/projects/dd2de7f457ca46488adfd23f67548802/users/fc092b8719264e7185893637b70ead99/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:56.245433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdbdce-5fd3-4da3-bca8-72378ad0d277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2de7f457ca46488adfd23f67548802, user_id=fc092b8719264e7185893637b70ead99, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:56.248120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdbdce-5fd3-4da3-bca8-72378ad0d277 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:56.259509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1283/2543] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:13:56 2021] PUT /identity/v3/projects/dd2de7f457ca46488adfd23f67548802/users/fc092b8719264e7185893637b70ead99/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:13:56.271227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04302102-bb7b-4685-b7cb-5cf7c614765b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:56.271758 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04302102-bb7b-4685-b7cb-5cf7c614765b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:56.272065 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04302102-bb7b-4685-b7cb-5cf7c614765b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:56.299637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-04302102-bb7b-4685-b7cb-5cf7c614765b None None] MFA Rules not processed for user `fc092b8719264e7185893637b70ead99`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:13:56.300778 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-04302102-bb7b-4685-b7cb-5cf7c614765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:56.373151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1261/2544] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:13:56 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:13:56.384996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdbdce-5fd3-4da3-bca8-72378ad0d277 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:56.387369 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-91cdbdce-5fd3-4da3-bca8-72378ad0d277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:56.464508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdbdce-5fd3-4da3-bca8-72378ad0d277 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:56.468910 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83803b-b477-4dfb-8ece-0635a6f1a2e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:56.469718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83803b-b477-4dfb-8ece-0635a6f1a2e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:56.470109 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83803b-b477-4dfb-8ece-0635a6f1a2e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:56.470550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83803b-b477-4dfb-8ece-0635a6f1a2e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:56.538312 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83803b-b477-4dfb-8ece-0635a6f1a2e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:56.539834 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83803b-b477-4dfb-8ece-0635a6f1a2e1 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:56.551267 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1284/2545] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:56 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:13:58.103642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04302102-bb7b-4685-b7cb-5cf7c614765b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:58.105704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-04302102-bb7b-4685-b7cb-5cf7c614765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:13:58.118877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04302102-bb7b-4685-b7cb-5cf7c614765b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:58.122745 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c7af-93a5-44da-8207-061848556314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:58.123384 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c7af-93a5-44da-8207-061848556314 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:58.123660 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c7af-93a5-44da-8207-061848556314 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:58.124087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c7af-93a5-44da-8207-061848556314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:58.190582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95c7af-93a5-44da-8207-061848556314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:58.192030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95c7af-93a5-44da-8207-061848556314 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:58.202476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1262/2546] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:58 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:13:58.936070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83803b-b477-4dfb-8ece-0635a6f1a2e1 service cinder] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:13:58.946239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83803b-b477-4dfb-8ece-0635a6f1a2e1 service cinder] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:13:58.950842 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103d7c-c954-40b2-bf81-98a72f383e9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:13:58.951482 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103d7c-c954-40b2-bf81-98a72f383e9b service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:13:58.951767 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103d7c-c954-40b2-bf81-98a72f383e9b service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:13:58.952047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103d7c-c954-40b2-bf81-98a72f383e9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:13:58.961503 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103d7c-c954-40b2-bf81-98a72f383e9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:13:58.963626 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103d7c-c954-40b2-bf81-98a72f383e9b service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:13:58.976157 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1285/2547] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:13:58 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:02.251782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c7af-93a5-44da-8207-061848556314 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:02.254099 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-3d95c7af-93a5-44da-8207-061848556314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:02.319807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c7af-93a5-44da-8207-061848556314 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:02.325013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:02.325923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:02.326208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:02.326526 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] PATH_INFO: `/v3/users/fc6ef8627a3a40638168ed0d45c19d95` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:02.327717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6ef8627a3a40638168ed0d45c19d95)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:02.329628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:02.376518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6ef8627a3a40638168ed0d45c19d95'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.383089 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6ef8627a3a40638168ed0d45c19d95'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.384407 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6ef8627a3a40638168ed0d45c19d95'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.385280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6ef8627a3a40638168ed0d45c19d95'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.397679 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6ef8627a3a40638168ed0d45c19d95'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.411293 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1263/2548] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:14:02 2021] DELETE /identity/v3/users/fc6ef8627a3a40638168ed0d45c19d95 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:14:02.580667 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103d7c-c954-40b2-bf81-98a72f383e9b service cinder] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:02.592771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103d7c-c954-40b2-bf81-98a72f383e9b service cinder] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:02.652978 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:02.654070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:02.654468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:02.654751 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] PATH_INFO: `/v3/projects/d6d5beaac0f5499ebdb7f15879cf5c9b` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:02.656224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d5beaac0f5499ebdb7f15879cf5c9b)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:02.658597 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:02.670398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:02.672184 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:02.709344 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'request_id': 'req-913a72a5-c84b-46f4-8479-1692e6f76ad6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.715803 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'request_id': 'req-913a72a5-c84b-46f4-8479-1692e6f76ad6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.723374 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'request_id': 'req-913a72a5-c84b-46f4-8479-1692e6f76ad6'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.733858 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] The token cache is being invalidate because project d6d5beaac0f5499ebdb7f15879cf5c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:14:02.734151 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.735125 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.735435 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aa1b2-5d36-4af0-bada-4575e38d493e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:02.736692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1286/2549] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:14:02 2021] DELETE /identity/v3/projects/d6d5beaac0f5499ebdb7f15879cf5c9b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:14:02.740586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:02.741890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:02.784905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a85d3c-ff24-44d8-9dd0-7a14ab5acd6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:02.785586 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a85d3c-ff24-44d8-9dd0-7a14ab5acd6f service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:02.785894 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a85d3c-ff24-44d8-9dd0-7a14ab5acd6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:02.786177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a85d3c-ff24-44d8-9dd0-7a14ab5acd6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:02.788123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e9a85d3c-ff24-44d8-9dd0-7a14ab5acd6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:02.805221 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a72a5-c84b-46f4-8479-1692e6f76ad6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:02.810637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e22a72-e1c2-4f6f-bc96-39657986722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:02.811524 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22a72-e1c2-4f6f-bc96-39657986722d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:02.811808 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22a72-e1c2-4f6f-bc96-39657986722d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:02.812079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22a72-e1c2-4f6f-bc96-39657986722d admin admin] PATH_INFO: `/v3/users/54a92a51bff1468ab022c03e531ecadf` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:02.813404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e22a72-e1c2-4f6f-bc96-39657986722d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a92a51bff1468ab022c03e531ecadf)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:02.815351 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e22a72-e1c2-4f6f-bc96-39657986722d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:02.855922 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a85d3c-ff24-44d8-9dd0-7a14ab5acd6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:02.857571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a85d3c-ff24-44d8-9dd0-7a14ab5acd6f service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:02.870069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1264/2550] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:02 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:02.870238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d5e22a72-e1c2-4f6f-bc96-39657986722d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a92a51bff1468ab022c03e531ecadf'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.870899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d5e22a72-e1c2-4f6f-bc96-39657986722d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a92a51bff1468ab022c03e531ecadf'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.877900 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d5e22a72-e1c2-4f6f-bc96-39657986722d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a92a51bff1468ab022c03e531ecadf'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.878616 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d5e22a72-e1c2-4f6f-bc96-39657986722d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a92a51bff1468ab022c03e531ecadf'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.890722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d5e22a72-e1c2-4f6f-bc96-39657986722d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a92a51bff1468ab022c03e531ecadf'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:02.892601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a85d3c-ff24-44d8-9dd0-7a14ab5acd6f service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:02.894089 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e9a85d3c-ff24-44d8-9dd0-7a14ab5acd6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:02.906468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1287/2551] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:14:02 2021] DELETE /identity/v3/users/54a92a51bff1468ab022c03e531ecadf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:14:02.908714 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a85d3c-ff24-44d8-9dd0-7a14ab5acd6f service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:02.975836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:02.976891 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:02.977185 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:02.978101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] PATH_INFO: `/v3/users/e37f2110e1ec47d9a0c527eae0affe51` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:02.979679 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37f2110e1ec47d9a0c527eae0affe51)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:02.981588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:03.030665 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37f2110e1ec47d9a0c527eae0affe51'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.038608 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37f2110e1ec47d9a0c527eae0affe51'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.040278 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37f2110e1ec47d9a0c527eae0affe51'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.040911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37f2110e1ec47d9a0c527eae0affe51'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.054446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37f2110e1ec47d9a0c527eae0affe51'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.074455 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1265/2552] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:14:02 2021] DELETE /identity/v3/users/e37f2110e1ec47d9a0c527eae0affe51 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:14:03.077608 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdad419-5642-4141-b338-90cd87a4cbb4 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.077892 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdad419-5642-4141-b338-90cd87a4cbb4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.078176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdad419-5642-4141-b338-90cd87a4cbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.092992 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:03.094427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:03.100836 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-bfdad419-5642-4141-b338-90cd87a4cbb4 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:03.102036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-bfdad419-5642-4141-b338-90cd87a4cbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:03.184404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1288/2553] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:03.190432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdad419-5642-4141-b338-90cd87a4cbb4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:03.191827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-bfdad419-5642-4141-b338-90cd87a4cbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:03.209249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0280e4-1cfe-45ad-be5c-20bc8a7c4fd2 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:03.216300 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddebc5-ed58-4362-b2c1-5a5c314645e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:03.217802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddebc5-ed58-4362-b2c1-5a5c314645e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.218105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddebc5-ed58-4362-b2c1-5a5c314645e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.218382 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddebc5-ed58-4362-b2c1-5a5c314645e2 admin admin] PATH_INFO: `/v3/projects/bf239eeb9e08457e981da3e1f0943a7a` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.219989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddebc5-ed58-4362-b2c1-5a5c314645e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf239eeb9e08457e981da3e1f0943a7a)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:03.222192 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddebc5-ed58-4362-b2c1-5a5c314645e2 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:03.257882 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdad419-5642-4141-b338-90cd87a4cbb4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:03.261855 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc9b08-2d6c-4dea-940e-c564955c7549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:03.262576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc9b08-2d6c-4dea-940e-c564955c7549 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.262983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc9b08-2d6c-4dea-940e-c564955c7549 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.263304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc9b08-2d6c-4dea-940e-c564955c7549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.273266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-90ddebc5-ed58-4362-b2c1-5a5c314645e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf239eeb9e08457e981da3e1f0943a7a', 'request_id': 'req-90ddebc5-ed58-4362-b2c1-5a5c314645e2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.277210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc9b08-2d6c-4dea-940e-c564955c7549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:03.278699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc9b08-2d6c-4dea-940e-c564955c7549 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:03.279528 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-90ddebc5-ed58-4362-b2c1-5a5c314645e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf239eeb9e08457e981da3e1f0943a7a', 'request_id': 'req-90ddebc5-ed58-4362-b2c1-5a5c314645e2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.285781 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-90ddebc5-ed58-4362-b2c1-5a5c314645e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf239eeb9e08457e981da3e1f0943a7a', 'request_id': 'req-90ddebc5-ed58-4362-b2c1-5a5c314645e2'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.288963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1289/2554] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:03.305601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-90ddebc5-ed58-4362-b2c1-5a5c314645e2 admin admin] The token cache is being invalidate because project bf239eeb9e08457e981da3e1f0943a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:14:03.305903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-90ddebc5-ed58-4362-b2c1-5a5c314645e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.306646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-90ddebc5-ed58-4362-b2c1-5a5c314645e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.308139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1266/2555] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:14:03 2021] DELETE /identity/v3/projects/bf239eeb9e08457e981da3e1f0943a7a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:14:03.314160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d805e-b501-435b-9a23-53bcee4d5084 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.314612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d805e-b501-435b-9a23-53bcee4d5084 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.315079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d805e-b501-435b-9a23-53bcee4d5084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.333902 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-171d805e-b501-435b-9a23-53bcee4d5084 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:03.335308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-171d805e-b501-435b-9a23-53bcee4d5084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:03.405894 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1290/2556] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:03.413869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6715e-20b7-43b9-a939-3913d6a7085c None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.414160 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6715e-20b7-43b9-a939-3913d6a7085c None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.414473 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6715e-20b7-43b9-a939-3913d6a7085c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.436512 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-87f6715e-20b7-43b9-a939-3913d6a7085c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:03.437944 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-87f6715e-20b7-43b9-a939-3913d6a7085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:03.447588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1267/2557] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:03.451723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d805e-b501-435b-9a23-53bcee4d5084 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:03.461459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d805e-b501-435b-9a23-53bcee4d5084 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:03.467408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46f50d-0c04-4199-b36c-e4f0cc6d78a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:03.468058 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46f50d-0c04-4199-b36c-e4f0cc6d78a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.468336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46f50d-0c04-4199-b36c-e4f0cc6d78a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.468609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46f50d-0c04-4199-b36c-e4f0cc6d78a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.469342 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46f50d-0c04-4199-b36c-e4f0cc6d78a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:14:03.469648 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46f50d-0c04-4199-b36c-e4f0cc6d78a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:03.471529 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46f50d-0c04-4199-b36c-e4f0cc6d78a6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:03.484635 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1291/2558] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:14:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:14:03.489267 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6715e-20b7-43b9-a939-3913d6a7085c None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:03.498518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6715e-20b7-43b9-a939-3913d6a7085c None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:03.503184 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7106-f97b-4c88-9eaa-74ffae5b8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:03.503827 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7106-f97b-4c88-9eaa-74ffae5b8998 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.504111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7106-f97b-4c88-9eaa-74ffae5b8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.504385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7106-f97b-4c88-9eaa-74ffae5b8998 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.505719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec7106-f97b-4c88-9eaa-74ffae5b8998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:03.507684 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec7106-f97b-4c88-9eaa-74ffae5b8998 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:03.534271 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1268/2559] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:14:03 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:14:03.541919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46f50d-0c04-4199-b36c-e4f0cc6d78a6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:03.556368 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46f50d-0c04-4199-b36c-e4f0cc6d78a6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:03.575227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7106-f97b-4c88-9eaa-74ffae5b8998 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:03.577045 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-05ec7106-f97b-4c88-9eaa-74ffae5b8998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:03.615073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979c4f6-dafc-4bbb-992b-7c550efd08ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:03.615777 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979c4f6-dafc-4bbb-992b-7c550efd08ef admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.616032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979c4f6-dafc-4bbb-992b-7c550efd08ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.616333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979c4f6-dafc-4bbb-992b-7c550efd08ef admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.617066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979c4f6-dafc-4bbb-992b-7c550efd08ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:03.619125 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979c4f6-dafc-4bbb-992b-7c550efd08ef admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:03.642213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1292/2560] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:14:03 2021] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:14:03.643727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979c4f6-dafc-4bbb-992b-7c550efd08ef admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:03.644435 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7106-f97b-4c88-9eaa-74ffae5b8998 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:03.649013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:03.650719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.650719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.650955 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] PATH_INFO: `/v3/projects/98af4aafd383400585148f49714381be` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.652149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98af4aafd383400585148f49714381be)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:03.654011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979c4f6-dafc-4bbb-992b-7c550efd08ef admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:03.654132 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:03.658883 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f98e79-74a0-4672-9018-d7d793614381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:03.659548 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f98e79-74a0-4672-9018-d7d793614381 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.659832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f98e79-74a0-4672-9018-d7d793614381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.660114 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f98e79-74a0-4672-9018-d7d793614381 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.660890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f98e79-74a0-4672-9018-d7d793614381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:03.662475 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f98e79-74a0-4672-9018-d7d793614381 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:03.672563 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1293/2561] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:14:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:14:03.676435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f98e79-74a0-4672-9018-d7d793614381 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:03.689403 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f98e79-74a0-4672-9018-d7d793614381 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:03.699239 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98af4aafd383400585148f49714381be', 'request_id': 'req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.704937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98af4aafd383400585148f49714381be', 'request_id': 'req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.712838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98af4aafd383400585148f49714381be', 'request_id': 'req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.733678 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] The token cache is being invalidate because project 98af4aafd383400585148f49714381be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:14:03.734115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.735167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.737152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1269/2562] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:14:03 2021] DELETE /identity/v3/projects/98af4aafd383400585148f49714381be => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:14:03.740989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:03.742542 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:03.749088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb581ba-e421-4730-ad6c-722310dfdfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:03.749747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb581ba-e421-4730-ad6c-722310dfdfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.750024 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb581ba-e421-4730-ad6c-722310dfdfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.750296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb581ba-e421-4730-ad6c-722310dfdfc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.751056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb581ba-e421-4730-ad6c-722310dfdfc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:03.752637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb581ba-e421-4730-ad6c-722310dfdfc9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:03.762827 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1294/2563] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:14:03 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:14:03.766950 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb581ba-e421-4730-ad6c-722310dfdfc9 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:03.769294 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-aeb581ba-e421-4730-ad6c-722310dfdfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:03.782464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb581ba-e421-4730-ad6c-722310dfdfc9 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:03.787132 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ee2a3-740a-462c-ab0f-447f0003ee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:03.788000 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee2a3-740a-462c-ab0f-447f0003ee44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.788285 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee2a3-740a-462c-ab0f-447f0003ee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.788562 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee2a3-740a-462c-ab0f-447f0003ee44 admin admin] PATH_INFO: `/v3/projects/b9af91ce42164b7d8dbeecc27f4698e8/users/eb1a5b2feb8e4f93a4eeb90de9adb927/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.803928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ee2a3-740a-462c-ab0f-447f0003ee44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9af91ce42164b7d8dbeecc27f4698e8, user_id=eb1a5b2feb8e4f93a4eeb90de9adb927, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:03.806719 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ee2a3-740a-462c-ab0f-447f0003ee44 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:03.811785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210cc20-d5d7-47a0-9ff4-deff75fd5b36 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:03.816841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:03.817785 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.818035 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.818388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] PATH_INFO: `/v3/users/9813928a77ee4dcb9ebe8acb10739f6b` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.819587 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1295/2564] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:14:03 2021] PUT /identity/v3/projects/b9af91ce42164b7d8dbeecc27f4698e8/users/eb1a5b2feb8e4f93a4eeb90de9adb927/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:14:03.819726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9813928a77ee4dcb9ebe8acb10739f6b)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:03.822088 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:03.825199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbccf4-fd41-4ac4-929a-7a9ca2ac21aa None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.825502 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbccf4-fd41-4ac4-929a-7a9ca2ac21aa None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.825757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbccf4-fd41-4ac4-929a-7a9ca2ac21aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:03.843646 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e3cbccf4-fd41-4ac4-929a-7a9ca2ac21aa None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:03.844869 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e3cbccf4-fd41-4ac4-929a-7a9ca2ac21aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:03.871699 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9813928a77ee4dcb9ebe8acb10739f6b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.878499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9813928a77ee4dcb9ebe8acb10739f6b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.879269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9813928a77ee4dcb9ebe8acb10739f6b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.879902 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9813928a77ee4dcb9ebe8acb10739f6b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.892023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9813928a77ee4dcb9ebe8acb10739f6b'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:03.905953 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1270/2565] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:14:03 2021] DELETE /identity/v3/users/9813928a77ee4dcb9ebe8acb10739f6b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:14:03.912907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1296/2566] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:14:03.925158 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:03.926631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:03.989405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408795c3-4665-4d00-a4f4-076bf49c032f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:03.994223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7af090-f421-4a44-9aaf-1786dbbf89c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:03.995005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7af090-f421-4a44-9aaf-1786dbbf89c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:03.995284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7af090-f421-4a44-9aaf-1786dbbf89c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:03.995555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7af090-f421-4a44-9aaf-1786dbbf89c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:04.063033 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7af090-f421-4a44-9aaf-1786dbbf89c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:04.065256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7af090-f421-4a44-9aaf-1786dbbf89c4 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:04.078006 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1271/2567] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:04.281743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbccf4-fd41-4ac4-929a-7a9ca2ac21aa None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:04.284017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e3cbccf4-fd41-4ac4-929a-7a9ca2ac21aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:04.300583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbccf4-fd41-4ac4-929a-7a9ca2ac21aa None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:04.308821 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:04.309747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:04.310092 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:04.310399 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] PATH_INFO: `/v3/projects/759def84ff0e4eb8a8ecdf648665db7a` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:04.312195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=759def84ff0e4eb8a8ecdf648665db7a)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:04.314498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:04.375669 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759def84ff0e4eb8a8ecdf648665db7a', 'request_id': 'req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:04.381968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759def84ff0e4eb8a8ecdf648665db7a', 'request_id': 'req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:04.391725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759def84ff0e4eb8a8ecdf648665db7a', 'request_id': 'req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:04.406565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] The token cache is being invalidate because project 759def84ff0e4eb8a8ecdf648665db7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:14:04.406874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:04.407588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:04.410648 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1297/2568] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:14:04 2021] DELETE /identity/v3/projects/759def84ff0e4eb8a8ecdf648665db7a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:14:04.415357 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7af090-f421-4a44-9aaf-1786dbbf89c4 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:04.427529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7af090-f421-4a44-9aaf-1786dbbf89c4 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:04.498992 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9674d90-69ec-4e68-8fb5-498fd86bc0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:04.500821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9674d90-69ec-4e68-8fb5-498fd86bc0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:04.501095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9674d90-69ec-4e68-8fb5-498fd86bc0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:04.501510 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9674d90-69ec-4e68-8fb5-498fd86bc0bc admin admin] PATH_INFO: `/v3/users/fc092b8719264e7185893637b70ead99` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:04.507836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9674d90-69ec-4e68-8fb5-498fd86bc0bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc092b8719264e7185893637b70ead99)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:04.511236 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9674d90-69ec-4e68-8fb5-498fd86bc0bc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:04.594322 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a9674d90-69ec-4e68-8fb5-498fd86bc0bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc092b8719264e7185893637b70ead99'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:04.606568 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a9674d90-69ec-4e68-8fb5-498fd86bc0bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc092b8719264e7185893637b70ead99'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:04.607340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a9674d90-69ec-4e68-8fb5-498fd86bc0bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc092b8719264e7185893637b70ead99'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:04.607955 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a9674d90-69ec-4e68-8fb5-498fd86bc0bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc092b8719264e7185893637b70ead99'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:04.622279 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a9674d90-69ec-4e68-8fb5-498fd86bc0bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc092b8719264e7185893637b70ead99'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:04.639143 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1272/2569] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:14:04 2021] DELETE /identity/v3/users/fc092b8719264e7185893637b70ead99 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:14:04.928244 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:04.931280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:04.944233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3dc1f-c24a-4b8f-a6ac-d235746cfcb4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:05.013833 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11855bb-d886-4ec4-8e59-a2826f8d0d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:05.014728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11855bb-d886-4ec4-8e59-a2826f8d0d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:05.015009 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11855bb-d886-4ec4-8e59-a2826f8d0d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:05.015281 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11855bb-d886-4ec4-8e59-a2826f8d0d90 admin admin] PATH_INFO: `/v3/projects/dd2de7f457ca46488adfd23f67548802` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:05.016483 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11855bb-d886-4ec4-8e59-a2826f8d0d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2de7f457ca46488adfd23f67548802)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:05.018453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11855bb-d886-4ec4-8e59-a2826f8d0d90 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:05.069470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b11855bb-d886-4ec4-8e59-a2826f8d0d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2de7f457ca46488adfd23f67548802', 'request_id': 'req-b11855bb-d886-4ec4-8e59-a2826f8d0d90'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:05.078178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b11855bb-d886-4ec4-8e59-a2826f8d0d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2de7f457ca46488adfd23f67548802', 'request_id': 'req-b11855bb-d886-4ec4-8e59-a2826f8d0d90'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:05.088377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b11855bb-d886-4ec4-8e59-a2826f8d0d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2de7f457ca46488adfd23f67548802', 'request_id': 'req-b11855bb-d886-4ec4-8e59-a2826f8d0d90'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:05.101110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b11855bb-d886-4ec4-8e59-a2826f8d0d90 admin admin] The token cache is being invalidate because project dd2de7f457ca46488adfd23f67548802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:14:05.103031 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b11855bb-d886-4ec4-8e59-a2826f8d0d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:05.103856 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b11855bb-d886-4ec4-8e59-a2826f8d0d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:05.106245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1298/2570] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:14:04 2021] DELETE /identity/v3/projects/dd2de7f457ca46488adfd23f67548802 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:14:05.112298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512052d-2241-4e86-9a40-d1b0ca8f6757 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:05.112573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512052d-2241-4e86-9a40-d1b0ca8f6757 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:05.112851 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512052d-2241-4e86-9a40-d1b0ca8f6757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:05.137396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-3512052d-2241-4e86-9a40-d1b0ca8f6757 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:05.138177 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-3512052d-2241-4e86-9a40-d1b0ca8f6757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:05.208167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1273/2571] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:05.216919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c48ba-bb28-4efe-a8de-52e7e093f5ad None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:05.217380 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c48ba-bb28-4efe-a8de-52e7e093f5ad None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:05.217825 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c48ba-bb28-4efe-a8de-52e7e093f5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:05.240998 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e67c48ba-bb28-4efe-a8de-52e7e093f5ad None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:05.242226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e67c48ba-bb28-4efe-a8de-52e7e093f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:05.251546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1299/2572] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:05.255730 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512052d-2241-4e86-9a40-d1b0ca8f6757 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:05.266098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512052d-2241-4e86-9a40-d1b0ca8f6757 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:05.271130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d08238-83c3-4a25-b985-a8cf0ba546a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:05.272136 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d08238-83c3-4a25-b985-a8cf0ba546a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:05.272439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d08238-83c3-4a25-b985-a8cf0ba546a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:05.272721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d08238-83c3-4a25-b985-a8cf0ba546a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:05.274480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d08238-83c3-4a25-b985-a8cf0ba546a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:14:05.274480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d08238-83c3-4a25-b985-a8cf0ba546a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:05.276891 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d08238-83c3-4a25-b985-a8cf0ba546a3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:05.290847 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1274/2573] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:14:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:14:05.294416 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c48ba-bb28-4efe-a8de-52e7e093f5ad None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:05.304011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c48ba-bb28-4efe-a8de-52e7e093f5ad None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:05.310041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba377d9-36d1-47a9-84b8-b381660c9198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:05.310743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba377d9-36d1-47a9-84b8-b381660c9198 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:05.311018 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba377d9-36d1-47a9-84b8-b381660c9198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:05.311605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba377d9-36d1-47a9-84b8-b381660c9198 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:05.312045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba377d9-36d1-47a9-84b8-b381660c9198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:05.314006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba377d9-36d1-47a9-84b8-b381660c9198 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:05.347267 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1300/2574] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:14:05 2021] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:14:05.351342 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d08238-83c3-4a25-b985-a8cf0ba546a3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:05.366930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d08238-83c3-4a25-b985-a8cf0ba546a3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:05.435446 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b6cec-7a0c-4537-b8f7-34c851178b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:05.436368 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b6cec-7a0c-4537-b8f7-34c851178b59 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:05.436733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b6cec-7a0c-4537-b8f7-34c851178b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:05.437079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b6cec-7a0c-4537-b8f7-34c851178b59 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:05.438247 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b6cec-7a0c-4537-b8f7-34c851178b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:05.443797 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b6cec-7a0c-4537-b8f7-34c851178b59 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:05.472977 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1275/2575] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:14:05 2021] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:14:05.477823 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba377d9-36d1-47a9-84b8-b381660c9198 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:05.494224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba377d9-36d1-47a9-84b8-b381660c9198 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:05.518811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99262a10-1ccf-4d94-9012-0d1bf338e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:05.520196 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99262a10-1ccf-4d94-9012-0d1bf338e4ae admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:05.521930 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99262a10-1ccf-4d94-9012-0d1bf338e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:05.521930 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99262a10-1ccf-4d94-9012-0d1bf338e4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:05.521930 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99262a10-1ccf-4d94-9012-0d1bf338e4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:05.524924 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99262a10-1ccf-4d94-9012-0d1bf338e4ae admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:05.538640 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1301/2576] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:14:05 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:14:05.543227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b6cec-7a0c-4537-b8f7-34c851178b59 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:05.555982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b6cec-7a0c-4537-b8f7-34c851178b59 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:05.561765 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f51aee-863c-4bb3-af45-0fd8758897e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:05.563769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f51aee-863c-4bb3-af45-0fd8758897e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:05.563769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f51aee-863c-4bb3-af45-0fd8758897e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:05.563947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f51aee-863c-4bb3-af45-0fd8758897e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:05.564942 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f51aee-863c-4bb3-af45-0fd8758897e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:05.567414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f51aee-863c-4bb3-af45-0fd8758897e0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:05.578947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1276/2577] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:14:05 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:14:05.583056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99262a10-1ccf-4d94-9012-0d1bf338e4ae admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:05.596234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99262a10-1ccf-4d94-9012-0d1bf338e4ae admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:05.601631 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a64273-f077-417d-b222-e871ee2382b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:05.603495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a64273-f077-417d-b222-e871ee2382b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:05.603834 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a64273-f077-417d-b222-e871ee2382b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:05.604115 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a64273-f077-417d-b222-e871ee2382b0 admin admin] PATH_INFO: `/v3/projects/291e12cb103f431eb5b92665f5915c25/users/a4b7c405265b4d17843899a57c7ca3d4/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:05.621691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a64273-f077-417d-b222-e871ee2382b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=291e12cb103f431eb5b92665f5915c25, user_id=a4b7c405265b4d17843899a57c7ca3d4, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:05.624612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a64273-f077-417d-b222-e871ee2382b0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:05.642350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1302/2578] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:14:05 2021] PUT /identity/v3/projects/291e12cb103f431eb5b92665f5915c25/users/a4b7c405265b4d17843899a57c7ca3d4/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:14:05.653286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50edca-0add-4b9f-988b-44b1212b4271 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:05.653286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50edca-0add-4b9f-988b-44b1212b4271 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:05.653286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50edca-0add-4b9f-988b-44b1212b4271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:05.694854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-6c50edca-0add-4b9f-988b-44b1212b4271 None None] MFA Rules not processed for user `a4b7c405265b4d17843899a57c7ca3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:05.697492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-6c50edca-0add-4b9f-988b-44b1212b4271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:05.833020 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1277/2579] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:05 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:05.833643 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a64273-f077-417d-b222-e871ee2382b0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:05.835501 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a8a64273-f077-417d-b222-e871ee2382b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:05.950124 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a64273-f077-417d-b222-e871ee2382b0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:05.954546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d952a-da2d-48ca-90b9-154ba677a99f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:05.955200 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d952a-da2d-48ca-90b9-154ba677a99f service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:05.955813 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d952a-da2d-48ca-90b9-154ba677a99f service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:05.956098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d952a-da2d-48ca-90b9-154ba677a99f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:05.968700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d952a-da2d-48ca-90b9-154ba677a99f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:05.970145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d952a-da2d-48ca-90b9-154ba677a99f service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:05.984039 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1303/2580] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:05 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:14:07.354057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acf507-26d1-4e34-8f00-f7f5acf4fad4 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:07.354658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acf507-26d1-4e34-8f00-f7f5acf4fad4 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:07.354658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acf507-26d1-4e34-8f00-f7f5acf4fad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:07.385882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-06acf507-26d1-4e34-8f00-f7f5acf4fad4 None None] MFA Rules not processed for user `a4b7c405265b4d17843899a57c7ca3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:07.387184 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-06acf507-26d1-4e34-8f00-f7f5acf4fad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:07.412078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1278/2581] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:07 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:07.492277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d952a-da2d-48ca-90b9-154ba677a99f service cinder] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:07.494292 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-cd8d952a-da2d-48ca-90b9-154ba677a99f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:07.669217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d952a-da2d-48ca-90b9-154ba677a99f service cinder] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:07.679283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e814-9d39-4dd2-8505-11099d4d2bac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:07.679971 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e814-9d39-4dd2-8505-11099d4d2bac service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:07.680972 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e814-9d39-4dd2-8505-11099d4d2bac service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:07.681532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e814-9d39-4dd2-8505-11099d4d2bac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:07.683752 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b9f5e814-9d39-4dd2-8505-11099d4d2bac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:07.703029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5e814-9d39-4dd2-8505-11099d4d2bac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:07.704928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5e814-9d39-4dd2-8505-11099d4d2bac service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:07.718164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1304/2582] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:08.496671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acf507-26d1-4e34-8f00-f7f5acf4fad4 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:08.499096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-06acf507-26d1-4e34-8f00-f7f5acf4fad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:08.694464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acf507-26d1-4e34-8f00-f7f5acf4fad4 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:08.714337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6b038-5177-4e64-8618-b3440a1e3d0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cebb33ff7c4e40a06b3c7f1a40823d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:08.715364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6b038-5177-4e64-8618-b3440a1e3d0a service placement] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:08.716486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6b038-5177-4e64-8618-b3440a1e3d0a service placement] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:08.718905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6b038-5177-4e64-8618-b3440a1e3d0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:08.724102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2fa6b038-5177-4e64-8618-b3440a1e3d0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:08.746701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6b038-5177-4e64-8618-b3440a1e3d0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:08.748629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6b038-5177-4e64-8618-b3440a1e3d0a service placement] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:08.762894 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1279/2583] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:10.728223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bc521-fa7c-4a77-9462-1f05cc1a8b42 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:10.728763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bc521-fa7c-4a77-9462-1f05cc1a8b42 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:10.728850 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bc521-fa7c-4a77-9462-1f05cc1a8b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:10.767461 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-f58bc521-fa7c-4a77-9462-1f05cc1a8b42 None None] MFA Rules not processed for user `eb1a5b2feb8e4f93a4eeb90de9adb927`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:10.769030 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f58bc521-fa7c-4a77-9462-1f05cc1a8b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:10.869527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1305/2584] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:10 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:10.874849 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6b038-5177-4e64-8618-b3440a1e3d0a service placement] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:10.876419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2fa6b038-5177-4e64-8618-b3440a1e3d0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:10.954835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6b038-5177-4e64-8618-b3440a1e3d0a service placement] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:10.959777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd427fa8-5002-4fa6-83ad-86fcae94446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:10.960627 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd427fa8-5002-4fa6-83ad-86fcae94446b admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:10.961067 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd427fa8-5002-4fa6-83ad-86fcae94446b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:10.962021 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd427fa8-5002-4fa6-83ad-86fcae94446b admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:10.962935 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd427fa8-5002-4fa6-83ad-86fcae94446b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:10.965359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd427fa8-5002-4fa6-83ad-86fcae94446b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:11.002476 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1280/2585] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:14:10 2021] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:14:11.006602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bc521-fa7c-4a77-9462-1f05cc1a8b42 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:11.022284 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bc521-fa7c-4a77-9462-1f05cc1a8b42 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:11.121238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5266502-62cd-44ce-ac55-daa8b281e135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:11.121928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5266502-62cd-44ce-ac55-daa8b281e135 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:11.122209 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5266502-62cd-44ce-ac55-daa8b281e135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:11.122510 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5266502-62cd-44ce-ac55-daa8b281e135 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:11.123219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5266502-62cd-44ce-ac55-daa8b281e135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:11.125141 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5266502-62cd-44ce-ac55-daa8b281e135 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:11.151485 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1306/2586] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:14:11 2021] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:14:11.155392 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd427fa8-5002-4fa6-83ad-86fcae94446b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:11.168819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd427fa8-5002-4fa6-83ad-86fcae94446b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:11.175711 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ae136-35c1-4178-a3b1-15a3a5b24e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:11.176421 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ae136-35c1-4178-a3b1-15a3a5b24e4f admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:11.176706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ae136-35c1-4178-a3b1-15a3a5b24e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:11.176986 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ae136-35c1-4178-a3b1-15a3a5b24e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:11.177734 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ae136-35c1-4178-a3b1-15a3a5b24e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:11.179369 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ae136-35c1-4178-a3b1-15a3a5b24e4f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:11.196561 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1281/2587] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:14:11 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:14:11.201338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5266502-62cd-44ce-ac55-daa8b281e135 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:11.211871 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5266502-62cd-44ce-ac55-daa8b281e135 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:11.217665 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236bf81-7149-4af7-81f3-d6cd176b9546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:11.218619 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236bf81-7149-4af7-81f3-d6cd176b9546 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:11.218902 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236bf81-7149-4af7-81f3-d6cd176b9546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:11.219177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236bf81-7149-4af7-81f3-d6cd176b9546 admin admin] PATH_INFO: `/v3/projects/c15cf460119f4743a9072d2d20a31f4a/users/64fe7e33da074880890ff49ec6ee4c16/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:11.237553 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236bf81-7149-4af7-81f3-d6cd176b9546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15cf460119f4743a9072d2d20a31f4a, user_id=64fe7e33da074880890ff49ec6ee4c16, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:11.240436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236bf81-7149-4af7-81f3-d6cd176b9546 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:11.255863 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1307/2588] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:14:11 2021] PUT /identity/v3/projects/c15cf460119f4743a9072d2d20a31f4a/users/64fe7e33da074880890ff49ec6ee4c16/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:14:11.260494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ae136-35c1-4178-a3b1-15a3a5b24e4f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:11.270485 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ae136-35c1-4178-a3b1-15a3a5b24e4f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:11.331606 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fe678-9389-439f-9574-eafc2762bb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:11.332499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fe678-9389-439f-9574-eafc2762bb8e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:11.333037 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fe678-9389-439f-9574-eafc2762bb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:11.333415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fe678-9389-439f-9574-eafc2762bb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:11.334267 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fe678-9389-439f-9574-eafc2762bb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:11.336190 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fe678-9389-439f-9574-eafc2762bb8e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:11.346738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1282/2589] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:14:11 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:14:11.350776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236bf81-7149-4af7-81f3-d6cd176b9546 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:11.362772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236bf81-7149-4af7-81f3-d6cd176b9546 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:11.373376 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffa4dd-e950-4a9a-b017-7fe130b7fab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:11.374348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffa4dd-e950-4a9a-b017-7fe130b7fab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:11.374823 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffa4dd-e950-4a9a-b017-7fe130b7fab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:11.375160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffa4dd-e950-4a9a-b017-7fe130b7fab6 admin admin] PATH_INFO: `/v3/projects/c15cf460119f4743a9072d2d20a31f4a/users/64fe7e33da074880890ff49ec6ee4c16/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:11.380784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffa4dd-e950-4a9a-b017-7fe130b7fab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15cf460119f4743a9072d2d20a31f4a, user_id=64fe7e33da074880890ff49ec6ee4c16, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:11.383918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffa4dd-e950-4a9a-b017-7fe130b7fab6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:11.395362 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1308/2590] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:14:11 2021] PUT /identity/v3/projects/c15cf460119f4743a9072d2d20a31f4a/users/64fe7e33da074880890ff49ec6ee4c16/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:14:11.834951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fe678-9389-439f-9574-eafc2762bb8e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:11.837436 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-fd7fe678-9389-439f-9574-eafc2762bb8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:11.940887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fe678-9389-439f-9574-eafc2762bb8e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:12.022040 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a83d9-c1e3-417b-8626-9e0b85e0a982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:12.023820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a83d9-c1e3-417b-8626-9e0b85e0a982 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:12.024314 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a83d9-c1e3-417b-8626-9e0b85e0a982 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:12.024766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a83d9-c1e3-417b-8626-9e0b85e0a982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:12.030954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4f6a83d9-c1e3-417b-8626-9e0b85e0a982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:12.044631 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a83d9-c1e3-417b-8626-9e0b85e0a982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:12.045780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a83d9-c1e3-417b-8626-9e0b85e0a982 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:12.055938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1283/2591] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:11 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:12.721035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05932e72-5363-4352-89fd-790918833ad7 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:12.721504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05932e72-5363-4352-89fd-790918833ad7 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:12.721612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05932e72-5363-4352-89fd-790918833ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:12.760541 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-05932e72-5363-4352-89fd-790918833ad7 None None] MFA Rules not processed for user `62defd8645f7454699ee5c7bb5930d16`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:12.764947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-05932e72-5363-4352-89fd-790918833ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:12.908415 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1309/2592] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:12 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:14.137927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a83d9-c1e3-417b-8626-9e0b85e0a982 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:14.140040 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4f6a83d9-c1e3-417b-8626-9e0b85e0a982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:14.151574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a83d9-c1e3-417b-8626-9e0b85e0a982 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:14.156007 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97f655-3a5c-422c-acb4-232c82dfc0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:14.157047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97f655-3a5c-422c-acb4-232c82dfc0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:14.158144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97f655-3a5c-422c-acb4-232c82dfc0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:14.158984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97f655-3a5c-422c-acb4-232c82dfc0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:14.165723 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-fd97f655-3a5c-422c-acb4-232c82dfc0a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:14.178528 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97f655-3a5c-422c-acb4-232c82dfc0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:14.180959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97f655-3a5c-422c-acb4-232c82dfc0a7 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:14.190560 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1284/2593] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:14 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:18.226203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05932e72-5363-4352-89fd-790918833ad7 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:18.228126 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-05932e72-5363-4352-89fd-790918833ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:18.408246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05932e72-5363-4352-89fd-790918833ad7 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:18.416230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ca65b-28ba-4d24-a16f-cd163bb66ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:18.417162 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ca65b-28ba-4d24-a16f-cd163bb66ef8 service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:18.417599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ca65b-28ba-4d24-a16f-cd163bb66ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:18.418211 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ca65b-28ba-4d24-a16f-cd163bb66ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:18.420352 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-395ca65b-28ba-4d24-a16f-cd163bb66ef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:18.446565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ca65b-28ba-4d24-a16f-cd163bb66ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:18.448676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ca65b-28ba-4d24-a16f-cd163bb66ef8 service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:18.498459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1310/2594] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:18 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:18.749095 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb162db3-48c7-46cd-932c-2122b6477914 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:18.750017 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb162db3-48c7-46cd-932c-2122b6477914 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:18.750605 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb162db3-48c7-46cd-932c-2122b6477914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:18.787362 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-fb162db3-48c7-46cd-932c-2122b6477914 None None] MFA Rules not processed for user `64fe7e33da074880890ff49ec6ee4c16`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:18.792147 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-fb162db3-48c7-46cd-932c-2122b6477914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:18.885461 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1285/2595] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:18 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:18.898898 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ca65b-28ba-4d24-a16f-cd163bb66ef8 service nova] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:18.912008 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ca65b-28ba-4d24-a16f-cd163bb66ef8 service nova] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:18.919295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655be7f-59df-48fb-8e2f-a583f554a89a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:18.919953 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655be7f-59df-48fb-8e2f-a583f554a89a service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:18.920235 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655be7f-59df-48fb-8e2f-a583f554a89a service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:18.920509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655be7f-59df-48fb-8e2f-a583f554a89a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:19.015921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655be7f-59df-48fb-8e2f-a583f554a89a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:19.017518 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655be7f-59df-48fb-8e2f-a583f554a89a service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:19.028292 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1311/2596] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:18 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:20.501860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368654fb-7d12-4f46-892a-6f641cba49ce None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:20.502422 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368654fb-7d12-4f46-892a-6f641cba49ce None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:20.502422 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368654fb-7d12-4f46-892a-6f641cba49ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:20.520696 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-368654fb-7d12-4f46-892a-6f641cba49ce None None] MFA Rules not processed for user `eb1a5b2feb8e4f93a4eeb90de9adb927`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:20.521894 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-368654fb-7d12-4f46-892a-6f641cba49ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:20.529029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1286/2597] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:20 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:22.579390 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fbe9d-e82f-4b23-b523-bd2fd7451017 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:22.579872 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fbe9d-e82f-4b23-b523-bd2fd7451017 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:22.580001 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fbe9d-e82f-4b23-b523-bd2fd7451017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:22.620120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-663fbe9d-e82f-4b23-b523-bd2fd7451017 None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:22.636498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-663fbe9d-e82f-4b23-b523-bd2fd7451017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:22.807039 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1312/2598] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:14:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:22.819825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368654fb-7d12-4f46-892a-6f641cba49ce None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:22.821282 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-368654fb-7d12-4f46-892a-6f641cba49ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:22.958618 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368654fb-7d12-4f46-892a-6f641cba49ce None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:22.985715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4d19f-22ca-4655-b4b0-e361ffe0111b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:22.986692 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4d19f-22ca-4655-b4b0-e361ffe0111b service swift] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:22.987196 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4d19f-22ca-4655-b4b0-e361ffe0111b service swift] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:22.988158 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4d19f-22ca-4655-b4b0-e361ffe0111b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:23.025771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4d19f-22ca-4655-b4b0-e361ffe0111b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:23.027662 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4d19f-22ca-4655-b4b0-e361ffe0111b service swift] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:23.063948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1287/2599] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:14:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 01:14:24.041381 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fbe9d-e82f-4b23-b523-bd2fd7451017 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:24.075401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fbe9d-e82f-4b23-b523-bd2fd7451017 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:24.088181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69e74f-47ab-41ae-bd44-ad0d51280509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:24.089596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69e74f-47ab-41ae-bd44-ad0d51280509 service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:24.090164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69e74f-47ab-41ae-bd44-ad0d51280509 service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:24.090735 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69e74f-47ab-41ae-bd44-ad0d51280509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:24.096280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6a69e74f-47ab-41ae-bd44-ad0d51280509 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:24.129026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69e74f-47ab-41ae-bd44-ad0d51280509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:24.131081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69e74f-47ab-41ae-bd44-ad0d51280509 service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:24.163742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1313/2600] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:32.205879 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52c1c5-bdf9-4805-93fa-cb0409fa39fb None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:32.206500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52c1c5-bdf9-4805-93fa-cb0409fa39fb None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:32.206500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52c1c5-bdf9-4805-93fa-cb0409fa39fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:32.228639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-6b52c1c5-bdf9-4805-93fa-cb0409fa39fb None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:32.230532 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-6b52c1c5-bdf9-4805-93fa-cb0409fa39fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:32.253076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1288/2601] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:14:32 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:32.303040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69e74f-47ab-41ae-bd44-ad0d51280509 service nova] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:32.323787 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69e74f-47ab-41ae-bd44-ad0d51280509 service nova] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:32.345360 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9faf17-167d-4f53-a686-5eb0ac1d3b3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:32.346559 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9faf17-167d-4f53-a686-5eb0ac1d3b3a service swift] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:32.347032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9faf17-167d-4f53-a686-5eb0ac1d3b3a service swift] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:32.347569 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9faf17-167d-4f53-a686-5eb0ac1d3b3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:32.358774 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9faf17-167d-4f53-a686-5eb0ac1d3b3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:32.360620 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9faf17-167d-4f53-a686-5eb0ac1d3b3a service swift] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:32.373459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1314/2602] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:14:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 01:14:33.113866 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409600b7-739e-4862-b2ef-f7e445c30faf None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:33.114178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409600b7-739e-4862-b2ef-f7e445c30faf None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:33.114500 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409600b7-739e-4862-b2ef-f7e445c30faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:33.135736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-409600b7-739e-4862-b2ef-f7e445c30faf None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:33.136955 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-409600b7-739e-4862-b2ef-f7e445c30faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:33.149161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1289/2603] 10.222.0.23 () {58 vars in 967 bytes} [Thu Dec 9 01:14:33 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:33.166126 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9faf17-167d-4f53-a686-5eb0ac1d3b3a service swift] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:33.177110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9faf17-167d-4f53-a686-5eb0ac1d3b3a service swift] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:33.183138 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2290b8e-4ff2-47b5-a20e-ad8678b1954e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:33.184309 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2290b8e-4ff2-47b5-a20e-ad8678b1954e service swift] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:33.185227 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2290b8e-4ff2-47b5-a20e-ad8678b1954e service swift] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:33.185781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2290b8e-4ff2-47b5-a20e-ad8678b1954e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:33.195440 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2290b8e-4ff2-47b5-a20e-ad8678b1954e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:33.197143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2290b8e-4ff2-47b5-a20e-ad8678b1954e service swift] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:33.208801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1315/2604] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:14:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 01:14:33.489759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4c033-5757-414d-ac0c-6dc9bfa040f5 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:33.490722 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4c033-5757-414d-ac0c-6dc9bfa040f5 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:33.491203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4c033-5757-414d-ac0c-6dc9bfa040f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:33.514835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-81f4c033-5757-414d-ac0c-6dc9bfa040f5 None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:33.516593 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-81f4c033-5757-414d-ac0c-6dc9bfa040f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:33.534987 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1290/2605] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:14:33 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:33.558904 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2290b8e-4ff2-47b5-a20e-ad8678b1954e service swift] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:33.580396 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2290b8e-4ff2-47b5-a20e-ad8678b1954e service swift] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:33.593321 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f670956-d0de-4342-a39d-abda24c6384f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:33.594121 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f670956-d0de-4342-a39d-abda24c6384f service swift] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:33.594790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f670956-d0de-4342-a39d-abda24c6384f service swift] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:33.597709 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f670956-d0de-4342-a39d-abda24c6384f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:33.610994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f670956-d0de-4342-a39d-abda24c6384f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:33.612717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f670956-d0de-4342-a39d-abda24c6384f service swift] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:33.623683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1316/2606] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:14:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 09 01:14:33.980039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4293-3e2c-4955-8c1f-441a02398ae1 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:33.980332 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4293-3e2c-4955-8c1f-441a02398ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:33.980609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4293-3e2c-4955-8c1f-441a02398ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:33.998206 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e6bd4293-3e2c-4955-8c1f-441a02398ae1 None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:33.999389 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e6bd4293-3e2c-4955-8c1f-441a02398ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:34.006547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1291/2607] 10.222.0.23 () {58 vars in 967 bytes} [Thu Dec 9 01:14:33 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:34.019198 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f670956-d0de-4342-a39d-abda24c6384f service swift] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:34.030146 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f670956-d0de-4342-a39d-abda24c6384f service swift] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:34.035107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b87d8-aba6-4e07-802d-7faaa0a61793 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:34.035725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b87d8-aba6-4e07-802d-7faaa0a61793 service swift] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:34.036001 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b87d8-aba6-4e07-802d-7faaa0a61793 service swift] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:34.036272 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b87d8-aba6-4e07-802d-7faaa0a61793 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:34.044688 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b87d8-aba6-4e07-802d-7faaa0a61793 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:34.046236 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b87d8-aba6-4e07-802d-7faaa0a61793 service swift] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:34.054023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1317/2608] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:14:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 01:14:36.200997 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4293-3e2c-4955-8c1f-441a02398ae1 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:36.261868 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4293-3e2c-4955-8c1f-441a02398ae1 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:36.266237 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:36.267116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:36.267397 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:36.267669 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] PATH_INFO: `/v3/users/a4b7c405265b4d17843899a57c7ca3d4` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:36.268852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b7c405265b4d17843899a57c7ca3d4)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:36.270787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:36.315396 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b7c405265b4d17843899a57c7ca3d4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:36.321976 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b7c405265b4d17843899a57c7ca3d4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:36.322801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b7c405265b4d17843899a57c7ca3d4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:36.323344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b7c405265b4d17843899a57c7ca3d4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:36.334816 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b7c405265b4d17843899a57c7ca3d4'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:36.347005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1292/2609] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:14:36 2021] DELETE /identity/v3/users/a4b7c405265b4d17843899a57c7ca3d4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:14:36.352205 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a464a-551e-4462-9299-c0183a165f54 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:36.352686 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a464a-551e-4462-9299-c0183a165f54 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:36.352785 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a464a-551e-4462-9299-c0183a165f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:36.370064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d01a464a-551e-4462-9299-c0183a165f54 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:36.371316 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d01a464a-551e-4462-9299-c0183a165f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:36.427314 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1318/2610] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:14:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:36.437838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:36.439181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:36.494048 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea971b9-1ecb-4bda-b421-e493b434084e admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:36.497797 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4dbe4-39a4-4c01-ab34-7fe1448d8c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:36.498470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4dbe4-39a4-4c01-ab34-7fe1448d8c47 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:36.498758 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4dbe4-39a4-4c01-ab34-7fe1448d8c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:36.499037 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4dbe4-39a4-4c01-ab34-7fe1448d8c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:36.508402 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4dbe4-39a4-4c01-ab34-7fe1448d8c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:36.509830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4dbe4-39a4-4c01-ab34-7fe1448d8c47 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:36.519126 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1293/2611] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:36.682732 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a464a-551e-4462-9299-c0183a165f54 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:36.684356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d01a464a-551e-4462-9299-c0183a165f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:36.696941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a464a-551e-4462-9299-c0183a165f54 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:36.701552 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:36.702598 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:36.702950 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:36.703234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1 admin admin] PATH_INFO: `/v3/projects/291e12cb103f431eb5b92665f5915c25` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:36.704447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=291e12cb103f431eb5b92665f5915c25)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:36.706378 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:36.753337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291e12cb103f431eb5b92665f5915c25', 'request_id': 'req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:36.759539 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291e12cb103f431eb5b92665f5915c25', 'request_id': 'req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:36.766538 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291e12cb103f431eb5b92665f5915c25', 'request_id': 'req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:36.776508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1 admin admin] The token cache is being invalidate because project 291e12cb103f431eb5b92665f5915c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:14:36.776788 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:36.777409 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5302eff0-ac0b-45ae-9c2e-4ebe396a76c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:14:36.778962 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1319/2612] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:14:36 2021] DELETE /identity/v3/projects/291e12cb103f431eb5b92665f5915c25 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:14:38.399816 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4dbe4-39a4-4c01-ab34-7fe1448d8c47 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:38.408115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4dbe4-39a4-4c01-ab34-7fe1448d8c47 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:38.459258 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6232e13-bc0e-4413-9650-f41c590530eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:38.459903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6232e13-bc0e-4413-9650-f41c590530eb service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:38.460189 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6232e13-bc0e-4413-9650-f41c590530eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:38.460468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6232e13-bc0e-4413-9650-f41c590530eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:38.462846 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e6232e13-bc0e-4413-9650-f41c590530eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:38.472400 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6232e13-bc0e-4413-9650-f41c590530eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:38.473830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6232e13-bc0e-4413-9650-f41c590530eb service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:38.482445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1294/2613] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:38 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:39.015723 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a8c6-9d7a-407d-8e4a-9f33bca53570 None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:39.016194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a8c6-9d7a-407d-8e4a-9f33bca53570 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:39.016194 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a8c6-9d7a-407d-8e4a-9f33bca53570 None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:39.017998 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1320/2614] 10.222.0.23 () {54 vars in 921 bytes} [Thu Dec 9 01:14:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:14:39.025103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf579b-05f6-40a0-925c-86b7808cfd78 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:39.025431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf579b-05f6-40a0-925c-86b7808cfd78 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:39.025721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf579b-05f6-40a0-925c-86b7808cfd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:39.068279 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-8bcf579b-05f6-40a0-925c-86b7808cfd78 None None] MFA Rules not processed for user `53d32ba063bc4a719d4c2f67d88ec640`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:39.069491 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8bcf579b-05f6-40a0-925c-86b7808cfd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:39.150944 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1295/2615] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Dec 9 01:14:39 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:14:39.164469 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63a8c6-9d7a-407d-8e4a-9f33bca53570 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:39.166477 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-db63a8c6-9d7a-407d-8e4a-9f33bca53570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:39.259743 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63a8c6-9d7a-407d-8e4a-9f33bca53570 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:39.266676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d961c4a-d85c-4482-8d7c-d18d7d7f2191 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d001733477f499e937ba90e7e50ba33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:39.267385 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d961c4a-d85c-4482-8d7c-d18d7d7f2191 service glance] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:39.267666 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d961c4a-d85c-4482-8d7c-d18d7d7f2191 service glance] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:39.268011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d961c4a-d85c-4482-8d7c-d18d7d7f2191 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:39.279447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d961c4a-d85c-4482-8d7c-d18d7d7f2191 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:39.280871 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d961c4a-d85c-4482-8d7c-d18d7d7f2191 service glance] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:39.293151 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1321/2616] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:39.362594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae223f82-6251-42f0-85fd-9581413344f7 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:39.362977 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae223f82-6251-42f0-85fd-9581413344f7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:39.363333 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae223f82-6251-42f0-85fd-9581413344f7 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:39.365193 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1296/2617] 10.222.0.23 () {54 vars in 921 bytes} [Thu Dec 9 01:14:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:14:39.371617 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63e8f-fbc6-4fe5-bba9-a63ff4973391 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:39.371903 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63e8f-fbc6-4fe5-bba9-a63ff4973391 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:39.372181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63e8f-fbc6-4fe5-bba9-a63ff4973391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:39.391075 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-04a63e8f-fbc6-4fe5-bba9-a63ff4973391 None None] MFA Rules not processed for user `0ab73b6f3a1949359549f91e1b708600`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:39.392291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-04a63e8f-fbc6-4fe5-bba9-a63ff4973391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:39.399122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1322/2618] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Dec 9 01:14:39 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:14:39.412470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae223f82-6251-42f0-85fd-9581413344f7 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:39.414248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ae223f82-6251-42f0-85fd-9581413344f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:39.427395 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae223f82-6251-42f0-85fd-9581413344f7 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:39.431975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b8796-4e07-4d83-a215-525f315a63a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:39.432759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8796-4e07-4d83-a215-525f315a63a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:39.433049 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8796-4e07-4d83-a215-525f315a63a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:39.433329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8796-4e07-4d83-a215-525f315a63a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:39.440984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b8796-4e07-4d83-a215-525f315a63a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:39.442431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b8796-4e07-4d83-a215-525f315a63a7 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:39.450690 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1297/2619] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:14:39 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:14:42.235621 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12a790-b65a-41a5-8236-0755e933411c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:42.236122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12a790-b65a-41a5-8236-0755e933411c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:42.236361 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12a790-b65a-41a5-8236-0755e933411c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:42.254997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-4c12a790-b65a-41a5-8236-0755e933411c None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:14:42.256190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-4c12a790-b65a-41a5-8236-0755e933411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:42.311297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1323/2620] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:14:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:14:42.325225 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b8796-4e07-4d83-a215-525f315a63a7 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:14:42.326664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7f4b8796-4e07-4d83-a215-525f315a63a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:14:42.395082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b8796-4e07-4d83-a215-525f315a63a7 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:14:42.400932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b431a4e-2076-4ea4-a37e-e8cedfac6177 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:14:42.401580 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431a4e-2076-4ea4-a37e-e8cedfac6177 service swift] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:14:42.401860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431a4e-2076-4ea4-a37e-e8cedfac6177 service swift] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:14:42.402129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431a4e-2076-4ea4-a37e-e8cedfac6177 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:14:42.410231 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b431a4e-2076-4ea4-a37e-e8cedfac6177 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:14:42.411917 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b431a4e-2076-4ea4-a37e-e8cedfac6177 service swift] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:14:42.420253 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1298/2621] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:14:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 01:15:05.282099 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12a790-b65a-41a5-8236-0755e933411c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:05.291151 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12a790-b65a-41a5-8236-0755e933411c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:05.294753 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65318ed9-d75c-4e0a-a218-cc40ad23f4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:05.295374 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65318ed9-d75c-4e0a-a218-cc40ad23f4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:05.295651 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65318ed9-d75c-4e0a-a218-cc40ad23f4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:05.295921 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65318ed9-d75c-4e0a-a218-cc40ad23f4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:05.297679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-65318ed9-d75c-4e0a-a218-cc40ad23f4f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:05.357681 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65318ed9-d75c-4e0a-a218-cc40ad23f4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:05.359149 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65318ed9-d75c-4e0a-a218-cc40ad23f4f0 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:05.368586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1324/2622] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:15:05 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:15:06.338592 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99ee7f-9d9c-413a-a049-1e4c9b77595b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:06.339153 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99ee7f-9d9c-413a-a049-1e4c9b77595b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:06.339153 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99ee7f-9d9c-413a-a049-1e4c9b77595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:06.357334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-8a99ee7f-9d9c-413a-a049-1e4c9b77595b None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:06.358486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8a99ee7f-9d9c-413a-a049-1e4c9b77595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:06.365875 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1299/2623] 10.222.0.23 () {58 vars in 967 bytes} [Thu Dec 9 01:15:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:06.393107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65318ed9-d75c-4e0a-a218-cc40ad23f4f0 service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:06.405297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65318ed9-d75c-4e0a-a218-cc40ad23f4f0 service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:06.410600 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544cfde-97f0-4db5-8f27-de94854d1f2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:06.411251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544cfde-97f0-4db5-8f27-de94854d1f2a service swift] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:06.411531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544cfde-97f0-4db5-8f27-de94854d1f2a service swift] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:06.411798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544cfde-97f0-4db5-8f27-de94854d1f2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:06.421476 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544cfde-97f0-4db5-8f27-de94854d1f2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:06.423219 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544cfde-97f0-4db5-8f27-de94854d1f2a service swift] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:06.431319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1325/2624] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:15:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 09 01:15:43.116830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99ee7f-9d9c-413a-a049-1e4c9b77595b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:43.126138 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99ee7f-9d9c-413a-a049-1e4c9b77595b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:43.129711 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7cce0-f7ee-4c0e-bf77-0ccfa1daba8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:43.130439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7cce0-f7ee-4c0e-bf77-0ccfa1daba8b service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:43.130720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7cce0-f7ee-4c0e-bf77-0ccfa1daba8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:43.131016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7cce0-f7ee-4c0e-bf77-0ccfa1daba8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:43.132803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-47d7cce0-f7ee-4c0e-bf77-0ccfa1daba8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:43.196595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7cce0-f7ee-4c0e-bf77-0ccfa1daba8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:43.198297 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7cce0-f7ee-4c0e-bf77-0ccfa1daba8b service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:43.210716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1300/2625] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:15:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:15:47.287781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544cfde-97f0-4db5-8f27-de94854d1f2a service swift] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:47.290428 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5544cfde-97f0-4db5-8f27-de94854d1f2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:47.307089 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544cfde-97f0-4db5-8f27-de94854d1f2a service swift] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:47.313260 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f071e55-9e6f-4857-ba11-a3ad05e94e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:47.314126 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f071e55-9e6f-4857-ba11-a3ad05e94e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:47.314429 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f071e55-9e6f-4857-ba11-a3ad05e94e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:47.314708 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f071e55-9e6f-4857-ba11-a3ad05e94e52 admin admin] PATH_INFO: `/v3/users/62defd8645f7454699ee5c7bb5930d16` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:47.315937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f071e55-9e6f-4857-ba11-a3ad05e94e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62defd8645f7454699ee5c7bb5930d16)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:47.317871 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f071e55-9e6f-4857-ba11-a3ad05e94e52 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:47.368958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3f071e55-9e6f-4857-ba11-a3ad05e94e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62defd8645f7454699ee5c7bb5930d16'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:47.369719 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3f071e55-9e6f-4857-ba11-a3ad05e94e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62defd8645f7454699ee5c7bb5930d16'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:47.377882 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3f071e55-9e6f-4857-ba11-a3ad05e94e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62defd8645f7454699ee5c7bb5930d16'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:47.378647 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3f071e55-9e6f-4857-ba11-a3ad05e94e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62defd8645f7454699ee5c7bb5930d16'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:47.394151 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3f071e55-9e6f-4857-ba11-a3ad05e94e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62defd8645f7454699ee5c7bb5930d16'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:47.407107 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1326/2626] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:15:47 2021] DELETE /identity/v3/users/62defd8645f7454699ee5c7bb5930d16 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:47.587364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7cce0-f7ee-4c0e-bf77-0ccfa1daba8b service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:47.601531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7cce0-f7ee-4c0e-bf77-0ccfa1daba8b service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:47.663923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ba1ee-404c-4a1a-8808-0890bf029a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:47.664775 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ba1ee-404c-4a1a-8808-0890bf029a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:47.665059 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ba1ee-404c-4a1a-8808-0890bf029a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:47.665337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ba1ee-404c-4a1a-8808-0890bf029a82 admin admin] PATH_INFO: `/v3/projects/853a8a131b9d4f239bc6b9dc03642f2e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:47.666575 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ba1ee-404c-4a1a-8808-0890bf029a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=853a8a131b9d4f239bc6b9dc03642f2e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:47.668596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ba1ee-404c-4a1a-8808-0890bf029a82 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:47.715550 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e84ba1ee-404c-4a1a-8808-0890bf029a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853a8a131b9d4f239bc6b9dc03642f2e', 'request_id': 'req-e84ba1ee-404c-4a1a-8808-0890bf029a82'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:47.721218 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e84ba1ee-404c-4a1a-8808-0890bf029a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853a8a131b9d4f239bc6b9dc03642f2e', 'request_id': 'req-e84ba1ee-404c-4a1a-8808-0890bf029a82'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:47.727249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e84ba1ee-404c-4a1a-8808-0890bf029a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853a8a131b9d4f239bc6b9dc03642f2e', 'request_id': 'req-e84ba1ee-404c-4a1a-8808-0890bf029a82'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:47.740733 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e84ba1ee-404c-4a1a-8808-0890bf029a82 admin admin] The token cache is being invalidate because project 853a8a131b9d4f239bc6b9dc03642f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:15:47.741016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e84ba1ee-404c-4a1a-8808-0890bf029a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:47.741645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-e84ba1ee-404c-4a1a-8808-0890bf029a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:47.743237 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1301/2627] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:15:47 2021] DELETE /identity/v3/projects/853a8a131b9d4f239bc6b9dc03642f2e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:47.751283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634cd8a-cea3-41fa-b8b2-6a187f8876bf None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:47.751573 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634cd8a-cea3-41fa-b8b2-6a187f8876bf None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:47.751862 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634cd8a-cea3-41fa-b8b2-6a187f8876bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:47.770153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-f634cd8a-cea3-41fa-b8b2-6a187f8876bf None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:47.771487 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-f634cd8a-cea3-41fa-b8b2-6a187f8876bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:47.831568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1327/2628] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:47.840565 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a1805-ae51-4a2b-aa70-046d71c67684 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:47.840859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a1805-ae51-4a2b-aa70-046d71c67684 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:47.841140 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a1805-ae51-4a2b-aa70-046d71c67684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:47.862724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-385a1805-ae51-4a2b-aa70-046d71c67684 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:47.863951 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-385a1805-ae51-4a2b-aa70-046d71c67684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:47.873410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1302/2629] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:47.878601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634cd8a-cea3-41fa-b8b2-6a187f8876bf None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:47.890198 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634cd8a-cea3-41fa-b8b2-6a187f8876bf None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:47.896347 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604963ce-8b5e-44df-b6eb-ae9eb6c93d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:47.897013 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604963ce-8b5e-44df-b6eb-ae9eb6c93d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:47.897296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604963ce-8b5e-44df-b6eb-ae9eb6c93d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:47.897601 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604963ce-8b5e-44df-b6eb-ae9eb6c93d0f admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:47.898382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604963ce-8b5e-44df-b6eb-ae9eb6c93d0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:15:47.898709 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604963ce-8b5e-44df-b6eb-ae9eb6c93d0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:47.900546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604963ce-8b5e-44df-b6eb-ae9eb6c93d0f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:47.913375 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1328/2630] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:15:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 01:15:47.917741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a1805-ae51-4a2b-aa70-046d71c67684 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:47.928329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a1805-ae51-4a2b-aa70-046d71c67684 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:47.934468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbcf31-902b-431a-894e-5de93f043c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:47.934468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbcf31-902b-431a-894e-5de93f043c99 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:47.934912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbcf31-902b-431a-894e-5de93f043c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:47.935188 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbcf31-902b-431a-894e-5de93f043c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:47.935894 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbcf31-902b-431a-894e-5de93f043c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:47.938724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbcf31-902b-431a-894e-5de93f043c99 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:47.978975 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1303/2631] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:15:47 2021] POST /identity/v3/projects => generated 401 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:15:47.980087 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604963ce-8b5e-44df-b6eb-ae9eb6c93d0f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:47.991048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604963ce-8b5e-44df-b6eb-ae9eb6c93d0f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:48.061313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbaef2-5467-4078-9ebe-74e3dfc14f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:48.062417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbaef2-5467-4078-9ebe-74e3dfc14f35 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.062946 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbaef2-5467-4078-9ebe-74e3dfc14f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.063460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbaef2-5467-4078-9ebe-74e3dfc14f35 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:48.064380 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbaef2-5467-4078-9ebe-74e3dfc14f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:48.066542 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbaef2-5467-4078-9ebe-74e3dfc14f35 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:48.086346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1329/2632] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:15:47 2021] POST /identity/v3/users => generated 301 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:15:48.091028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbcf31-902b-431a-894e-5de93f043c99 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:48.103882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbcf31-902b-431a-894e-5de93f043c99 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:48.110009 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea064e31-ea7c-4d4f-b5f6-cafc206c6f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:48.110720 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea064e31-ea7c-4d4f-b5f6-cafc206c6f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.111082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea064e31-ea7c-4d4f-b5f6-cafc206c6f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.111284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea064e31-ea7c-4d4f-b5f6-cafc206c6f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:48.112055 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea064e31-ea7c-4d4f-b5f6-cafc206c6f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:48.113666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea064e31-ea7c-4d4f-b5f6-cafc206c6f72 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:48.124991 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1304/2633] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:15:48 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:15:48.129071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbaef2-5467-4078-9ebe-74e3dfc14f35 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:48.142547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbaef2-5467-4078-9ebe-74e3dfc14f35 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:48.147982 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704fc68-f73e-43ca-9504-344edd498ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:48.148684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704fc68-f73e-43ca-9504-344edd498ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.148983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704fc68-f73e-43ca-9504-344edd498ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.149251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704fc68-f73e-43ca-9504-344edd498ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:48.149991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704fc68-f73e-43ca-9504-344edd498ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:48.151636 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704fc68-f73e-43ca-9504-344edd498ee3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:48.167617 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1330/2634] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:15:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:15:48.168981 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea064e31-ea7c-4d4f-b5f6-cafc206c6f72 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:48.179707 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea064e31-ea7c-4d4f-b5f6-cafc206c6f72 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:48.184462 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80201c-3682-42c6-86a3-78202c94d6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:48.185342 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80201c-3682-42c6-86a3-78202c94d6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.185634 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80201c-3682-42c6-86a3-78202c94d6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.185930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80201c-3682-42c6-86a3-78202c94d6ec admin admin] PATH_INFO: `/v3/projects/d80afdb85a0d4138903e2da04e951150/users/3e79f964a71a4ae587e7f52357693d19/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:48.201222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80201c-3682-42c6-86a3-78202c94d6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80afdb85a0d4138903e2da04e951150, user_id=3e79f964a71a4ae587e7f52357693d19, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:48.204450 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80201c-3682-42c6-86a3-78202c94d6ec admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:48.220274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1305/2635] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:15:48 2021] PUT /identity/v3/projects/d80afdb85a0d4138903e2da04e951150/users/3e79f964a71a4ae587e7f52357693d19/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:15:48.231609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ae92b-58f4-4393-90d0-7a206c970058 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.231984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ae92b-58f4-4393-90d0-7a206c970058 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.232327 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ae92b-58f4-4393-90d0-7a206c970058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:48.262421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-542ae92b-58f4-4393-90d0-7a206c970058 None None] MFA Rules not processed for user `3e79f964a71a4ae587e7f52357693d19`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:48.263593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-542ae92b-58f4-4393-90d0-7a206c970058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:48.345010 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1331/2636] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:48 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:15:48.346914 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80201c-3682-42c6-86a3-78202c94d6ec admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:48.414228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80201c-3682-42c6-86a3-78202c94d6ec admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:48.419481 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b134b0f-e51f-4e22-994a-d4bd5669abdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:48.420141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b134b0f-e51f-4e22-994a-d4bd5669abdd admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.420429 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b134b0f-e51f-4e22-994a-d4bd5669abdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.420709 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b134b0f-e51f-4e22-994a-d4bd5669abdd admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:48.421434 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b134b0f-e51f-4e22-994a-d4bd5669abdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:48.423544 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b134b0f-e51f-4e22-994a-d4bd5669abdd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:48.454727 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ae92b-58f4-4393-90d0-7a206c970058 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:48.455244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1306/2637] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:15:48 2021] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:15:48.466783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ae92b-58f4-4393-90d0-7a206c970058 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:48.527661 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c632de0-d96a-4f8a-81f6-a354eea425a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:48.528728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c632de0-d96a-4f8a-81f6-a354eea425a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.529055 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c632de0-d96a-4f8a-81f6-a354eea425a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.529442 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c632de0-d96a-4f8a-81f6-a354eea425a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:48.530517 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c632de0-d96a-4f8a-81f6-a354eea425a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:48.532626 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c632de0-d96a-4f8a-81f6-a354eea425a7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:48.563114 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1332/2638] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:15:48 2021] POST /identity/v3/users => generated 306 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:15:48.566490 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b134b0f-e51f-4e22-994a-d4bd5669abdd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:48.578234 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b134b0f-e51f-4e22-994a-d4bd5669abdd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:48.583355 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e7fe9-7039-4f5b-a898-206e08161afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:48.584154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e7fe9-7039-4f5b-a898-206e08161afe admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.584547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e7fe9-7039-4f5b-a898-206e08161afe admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.584926 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e7fe9-7039-4f5b-a898-206e08161afe admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:48.585771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e7fe9-7039-4f5b-a898-206e08161afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:48.587824 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e7fe9-7039-4f5b-a898-206e08161afe admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:48.602183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1307/2639] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:15:48 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:15:48.603395 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c632de0-d96a-4f8a-81f6-a354eea425a7 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:48.617262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c632de0-d96a-4f8a-81f6-a354eea425a7 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:48.622584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fbdab-5590-402b-acbe-11a0e282a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:48.623722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fbdab-5590-402b-acbe-11a0e282a110 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.624757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fbdab-5590-402b-acbe-11a0e282a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.625048 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fbdab-5590-402b-acbe-11a0e282a110 admin admin] PATH_INFO: `/v3/projects/6fe999a474a94d2ea4528cfb71b3b83a/users/a565504fcbe247eeab9e46f12540824c/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:48.643556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fbdab-5590-402b-acbe-11a0e282a110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe999a474a94d2ea4528cfb71b3b83a, user_id=a565504fcbe247eeab9e46f12540824c, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:48.646594 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fbdab-5590-402b-acbe-11a0e282a110 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:48.662306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1333/2640] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:15:48 2021] PUT /identity/v3/projects/6fe999a474a94d2ea4528cfb71b3b83a/users/a565504fcbe247eeab9e46f12540824c/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:48.666717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e7fe9-7039-4f5b-a898-206e08161afe admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:48.690931 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e7fe9-7039-4f5b-a898-206e08161afe admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:48.765102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81174434-8ff4-4f1b-8a12-1f9f034cc452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:48.765770 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81174434-8ff4-4f1b-8a12-1f9f034cc452 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.766059 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81174434-8ff4-4f1b-8a12-1f9f034cc452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.766337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81174434-8ff4-4f1b-8a12-1f9f034cc452 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:48.767135 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81174434-8ff4-4f1b-8a12-1f9f034cc452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:48.768726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81174434-8ff4-4f1b-8a12-1f9f034cc452 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:48.778831 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1308/2641] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:15:48 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:15:48.783568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fbdab-5590-402b-acbe-11a0e282a110 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:48.795368 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fbdab-5590-402b-acbe-11a0e282a110 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:48.800849 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694630e7-d7bf-46f0-8c29-c6b243f6dddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:48.801881 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694630e7-d7bf-46f0-8c29-c6b243f6dddd admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.802337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694630e7-d7bf-46f0-8c29-c6b243f6dddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.802821 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694630e7-d7bf-46f0-8c29-c6b243f6dddd admin admin] PATH_INFO: `/v3/projects/6fe999a474a94d2ea4528cfb71b3b83a/users/a565504fcbe247eeab9e46f12540824c/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:48.804852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694630e7-d7bf-46f0-8c29-c6b243f6dddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe999a474a94d2ea4528cfb71b3b83a, user_id=a565504fcbe247eeab9e46f12540824c, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:48.807604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694630e7-d7bf-46f0-8c29-c6b243f6dddd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:48.818497 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1334/2642] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:15:48 2021] PUT /identity/v3/projects/6fe999a474a94d2ea4528cfb71b3b83a/users/a565504fcbe247eeab9e46f12540824c/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:48.828706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd6128-d8c6-4b54-a5a2-c8cc6e92539e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.829068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd6128-d8c6-4b54-a5a2-c8cc6e92539e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.829349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd6128-d8c6-4b54-a5a2-c8cc6e92539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:48.857940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-45dd6128-d8c6-4b54-a5a2-c8cc6e92539e None None] MFA Rules not processed for user `a565504fcbe247eeab9e46f12540824c`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:48.860138 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-45dd6128-d8c6-4b54-a5a2-c8cc6e92539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:48.930316 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1309/2643] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:48 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:48.940567 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694630e7-d7bf-46f0-8c29-c6b243f6dddd admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:48.942289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-694630e7-d7bf-46f0-8c29-c6b243f6dddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:48.994980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f745e7-e4f8-4304-ae7d-5882b8a8a47a None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:48.995267 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f745e7-e4f8-4304-ae7d-5882b8a8a47a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:48.995571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f745e7-e4f8-4304-ae7d-5882b8a8a47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:49.003028 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694630e7-d7bf-46f0-8c29-c6b243f6dddd admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:49.007250 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fd1fb-96c9-4fba-af46-6d93fdc6220c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:49.007893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fd1fb-96c9-4fba-af46-6d93fdc6220c service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:49.008179 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fd1fb-96c9-4fba-af46-6d93fdc6220c service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:49.008447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fd1fb-96c9-4fba-af46-6d93fdc6220c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:49.013610 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-16f745e7-e4f8-4304-ae7d-5882b8a8a47a None None] MFA Rules not processed for user `e10d73a08d6e43e79df2c2e1d3161b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:49.014873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-16f745e7-e4f8-4304-ae7d-5882b8a8a47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:49.017973 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fd1fb-96c9-4fba-af46-6d93fdc6220c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:49.019471 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fd1fb-96c9-4fba-af46-6d93fdc6220c service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:49.029201 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1335/2644] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:15:48 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:15:49.069754 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1310/2645] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:48 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:15:49.104210 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fd1fb-96c9-4fba-af46-6d93fdc6220c service cinder] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:49.112785 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fd1fb-96c9-4fba-af46-6d93fdc6220c service cinder] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:49.116472 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c207a52-5dca-412d-9c6e-56a458d5c748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:49.117104 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c207a52-5dca-412d-9c6e-56a458d5c748 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:49.117402 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c207a52-5dca-412d-9c6e-56a458d5c748 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:49.117679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c207a52-5dca-412d-9c6e-56a458d5c748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:49.176383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c207a52-5dca-412d-9c6e-56a458d5c748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:49.177802 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c207a52-5dca-412d-9c6e-56a458d5c748 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:49.187404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1336/2646] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:15:49 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:15:53.300005 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f745e7-e4f8-4304-ae7d-5882b8a8a47a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:53.372589 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f745e7-e4f8-4304-ae7d-5882b8a8a47a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:53.377229 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:53.378098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:53.378440 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:53.378701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] PATH_INFO: `/v3/users/3e79f964a71a4ae587e7f52357693d19` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:53.379899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e79f964a71a4ae587e7f52357693d19)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:53.381809 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:53.429648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e79f964a71a4ae587e7f52357693d19'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:53.436233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e79f964a71a4ae587e7f52357693d19'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:53.437014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e79f964a71a4ae587e7f52357693d19'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:53.437564 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e79f964a71a4ae587e7f52357693d19'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:53.448920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e79f964a71a4ae587e7f52357693d19'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:53.462040 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1311/2647] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:15:53 2021] DELETE /identity/v3/users/3e79f964a71a4ae587e7f52357693d19 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:53.466584 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac64dd-0c00-4849-b5b0-316439b7735c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:53.467061 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac64dd-0c00-4849-b5b0-316439b7735c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:53.467160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac64dd-0c00-4849-b5b0-316439b7735c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:53.485347 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-85ac64dd-0c00-4849-b5b0-316439b7735c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:53.486596 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-85ac64dd-0c00-4849-b5b0-316439b7735c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:53.542452 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1337/2648] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:53.553047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:53.554522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:53.613932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7406e7-430d-4127-9536-a66c89fc1a94 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:53.617495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a37f3-8934-4ba3-b5de-70e81a2db7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:53.618128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a37f3-8934-4ba3-b5de-70e81a2db7ea service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:53.618437 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a37f3-8934-4ba3-b5de-70e81a2db7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:53.618717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a37f3-8934-4ba3-b5de-70e81a2db7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:53.628130 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a37f3-8934-4ba3-b5de-70e81a2db7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:53.629551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a37f3-8934-4ba3-b5de-70e81a2db7ea service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:53.638843 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1312/2649] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:15:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:15:53.898625 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac64dd-0c00-4849-b5b0-316439b7735c None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:53.900171 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-85ac64dd-0c00-4849-b5b0-316439b7735c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:53.914174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac64dd-0c00-4849-b5b0-316439b7735c None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:53.919822 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:53.920672 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:53.920955 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:53.921242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] PATH_INFO: `/v3/projects/d80afdb85a0d4138903e2da04e951150` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:53.922473 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80afdb85a0d4138903e2da04e951150)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:53.924414 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:53.980975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80afdb85a0d4138903e2da04e951150', 'request_id': 'req-24f91aad-ae15-4db2-93cc-34e770f260b1'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:53.987049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80afdb85a0d4138903e2da04e951150', 'request_id': 'req-24f91aad-ae15-4db2-93cc-34e770f260b1'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:53.994479 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80afdb85a0d4138903e2da04e951150', 'request_id': 'req-24f91aad-ae15-4db2-93cc-34e770f260b1'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.005401 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] The token cache is being invalidate because project d80afdb85a0d4138903e2da04e951150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:15:54.005689 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.006301 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.007936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1338/2650] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:15:53 2021] DELETE /identity/v3/projects/d80afdb85a0d4138903e2da04e951150 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:54.011928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a37f3-8934-4ba3-b5de-70e81a2db7ea service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:54.022308 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a37f3-8934-4ba3-b5de-70e81a2db7ea service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:54.077230 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e848a8-cd38-4656-aa54-43b6adb0d221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:54.079061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e848a8-cd38-4656-aa54-43b6adb0d221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:54.079344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e848a8-cd38-4656-aa54-43b6adb0d221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:54.079621 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e848a8-cd38-4656-aa54-43b6adb0d221 admin admin] PATH_INFO: `/v3/users/a565504fcbe247eeab9e46f12540824c` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:54.080860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e848a8-cd38-4656-aa54-43b6adb0d221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a565504fcbe247eeab9e46f12540824c)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:54.082823 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e848a8-cd38-4656-aa54-43b6adb0d221 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:54.126912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d7e848a8-cd38-4656-aa54-43b6adb0d221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a565504fcbe247eeab9e46f12540824c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.133361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d7e848a8-cd38-4656-aa54-43b6adb0d221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a565504fcbe247eeab9e46f12540824c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.134001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d7e848a8-cd38-4656-aa54-43b6adb0d221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a565504fcbe247eeab9e46f12540824c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.134620 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d7e848a8-cd38-4656-aa54-43b6adb0d221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a565504fcbe247eeab9e46f12540824c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.146420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-d7e848a8-cd38-4656-aa54-43b6adb0d221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a565504fcbe247eeab9e46f12540824c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.158839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1313/2651] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:15:54 2021] DELETE /identity/v3/users/a565504fcbe247eeab9e46f12540824c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:54.531980 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:54.534066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:54.548591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f91aad-ae15-4db2-93cc-34e770f260b1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:54.607692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041fcb7-343c-41f8-bed8-b44417aa9fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:54.608580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041fcb7-343c-41f8-bed8-b44417aa9fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:54.610088 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041fcb7-343c-41f8-bed8-b44417aa9fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:54.610382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041fcb7-343c-41f8-bed8-b44417aa9fe0 admin admin] PATH_INFO: `/v3/projects/6fe999a474a94d2ea4528cfb71b3b83a` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:54.611610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041fcb7-343c-41f8-bed8-b44417aa9fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe999a474a94d2ea4528cfb71b3b83a)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:54.613500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041fcb7-343c-41f8-bed8-b44417aa9fe0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:54.658958 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3041fcb7-343c-41f8-bed8-b44417aa9fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe999a474a94d2ea4528cfb71b3b83a', 'request_id': 'req-3041fcb7-343c-41f8-bed8-b44417aa9fe0'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.666122 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3041fcb7-343c-41f8-bed8-b44417aa9fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe999a474a94d2ea4528cfb71b3b83a', 'request_id': 'req-3041fcb7-343c-41f8-bed8-b44417aa9fe0'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.674227 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3041fcb7-343c-41f8-bed8-b44417aa9fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe999a474a94d2ea4528cfb71b3b83a', 'request_id': 'req-3041fcb7-343c-41f8-bed8-b44417aa9fe0'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.684214 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3041fcb7-343c-41f8-bed8-b44417aa9fe0 admin admin] The token cache is being invalidate because project 6fe999a474a94d2ea4528cfb71b3b83a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:15:54.684498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3041fcb7-343c-41f8-bed8-b44417aa9fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.685110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3041fcb7-343c-41f8-bed8-b44417aa9fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:54.686660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1339/2652] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:15:54 2021] DELETE /identity/v3/projects/6fe999a474a94d2ea4528cfb71b3b83a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:54.692365 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e0bee-a379-40f3-ac45-e7903ca576af None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:54.692841 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e0bee-a379-40f3-ac45-e7903ca576af None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:54.692948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e0bee-a379-40f3-ac45-e7903ca576af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:54.711601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-978e0bee-a379-40f3-ac45-e7903ca576af None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:54.712815 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-978e0bee-a379-40f3-ac45-e7903ca576af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:54.771274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1314/2653] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:54.779113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c448aa-fbd2-4c44-8eba-e7112c1902d0 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:54.779408 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c448aa-fbd2-4c44-8eba-e7112c1902d0 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:54.779692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c448aa-fbd2-4c44-8eba-e7112c1902d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:54.798913 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-a3c448aa-fbd2-4c44-8eba-e7112c1902d0 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:54.800116 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a3c448aa-fbd2-4c44-8eba-e7112c1902d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:54.808101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1340/2654] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:54.812256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e0bee-a379-40f3-ac45-e7903ca576af None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:54.821803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e0bee-a379-40f3-ac45-e7903ca576af None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:54.826394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485bce2-0826-4149-89bb-1a8a5e843cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:54.827060 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485bce2-0826-4149-89bb-1a8a5e843cdd admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:54.827344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485bce2-0826-4149-89bb-1a8a5e843cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:54.827676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485bce2-0826-4149-89bb-1a8a5e843cdd admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:54.828414 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485bce2-0826-4149-89bb-1a8a5e843cdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:15:54.828728 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485bce2-0826-4149-89bb-1a8a5e843cdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:54.830335 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485bce2-0826-4149-89bb-1a8a5e843cdd admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:54.842291 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1315/2655] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:15:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:15:54.847766 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c448aa-fbd2-4c44-8eba-e7112c1902d0 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:54.856986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c448aa-fbd2-4c44-8eba-e7112c1902d0 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:54.862636 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e00b6-16ad-498b-a610-5ad7aafe5fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:54.863294 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e00b6-16ad-498b-a610-5ad7aafe5fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:54.863581 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e00b6-16ad-498b-a610-5ad7aafe5fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:54.863860 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e00b6-16ad-498b-a610-5ad7aafe5fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:54.864573 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e00b6-16ad-498b-a610-5ad7aafe5fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:54.866492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e00b6-16ad-498b-a610-5ad7aafe5fd8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:54.892817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1341/2656] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:15:54 2021] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:15:54.897098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485bce2-0826-4149-89bb-1a8a5e843cdd admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:54.908790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485bce2-0826-4149-89bb-1a8a5e843cdd admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:54.964106 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205bf90-9056-43f1-98b8-b527687fc88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:54.964766 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205bf90-9056-43f1-98b8-b527687fc88f admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:54.965044 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205bf90-9056-43f1-98b8-b527687fc88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:54.965318 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205bf90-9056-43f1-98b8-b527687fc88f admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:54.966024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205bf90-9056-43f1-98b8-b527687fc88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:54.967954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205bf90-9056-43f1-98b8-b527687fc88f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:54.988596 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1316/2657] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:15:54 2021] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:15:54.992573 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e00b6-16ad-498b-a610-5ad7aafe5fd8 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:55.002757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e00b6-16ad-498b-a610-5ad7aafe5fd8 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:55.007484 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d837c52-483b-4473-933b-8dd9e458faee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:55.008132 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d837c52-483b-4473-933b-8dd9e458faee admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.008416 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d837c52-483b-4473-933b-8dd9e458faee admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.008691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d837c52-483b-4473-933b-8dd9e458faee admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.009427 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d837c52-483b-4473-933b-8dd9e458faee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:55.011100 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d837c52-483b-4473-933b-8dd9e458faee admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:55.021791 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1342/2658] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:15:55.025511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205bf90-9056-43f1-98b8-b527687fc88f admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:55.035873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205bf90-9056-43f1-98b8-b527687fc88f admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:55.040541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1a27e-ae49-4e50-94f2-a1b1600de97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:55.041180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1a27e-ae49-4e50-94f2-a1b1600de97e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.041464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1a27e-ae49-4e50-94f2-a1b1600de97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.041759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1a27e-ae49-4e50-94f2-a1b1600de97e admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.042509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1a27e-ae49-4e50-94f2-a1b1600de97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:55.044093 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1a27e-ae49-4e50-94f2-a1b1600de97e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:55.054483 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1317/2659] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:15:55 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:15:55.058353 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d837c52-483b-4473-933b-8dd9e458faee admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:55.068605 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d837c52-483b-4473-933b-8dd9e458faee admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:55.073319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dce47-042e-42ea-87c1-51b77c38ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:55.074178 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dce47-042e-42ea-87c1-51b77c38ca2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.074489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dce47-042e-42ea-87c1-51b77c38ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.074764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dce47-042e-42ea-87c1-51b77c38ca2d admin admin] PATH_INFO: `/v3/projects/4c5eee839ac54b17be4dfc29a6f2fd79/users/a3b3498f48be40c6865d095702f74f52/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.089470 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dce47-042e-42ea-87c1-51b77c38ca2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5eee839ac54b17be4dfc29a6f2fd79, user_id=a3b3498f48be40c6865d095702f74f52, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:55.092141 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dce47-042e-42ea-87c1-51b77c38ca2d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:55.105190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1343/2660] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:15:55 2021] PUT /identity/v3/projects/4c5eee839ac54b17be4dfc29a6f2fd79/users/a3b3498f48be40c6865d095702f74f52/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:55.116969 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a299ad-3c09-4452-b693-e013e77e65f9 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.117271 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a299ad-3c09-4452-b693-e013e77e65f9 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.117554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a299ad-3c09-4452-b693-e013e77e65f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.144110 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-e0a299ad-3c09-4452-b693-e013e77e65f9 None None] MFA Rules not processed for user `a3b3498f48be40c6865d095702f74f52`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:55.145360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e0a299ad-3c09-4452-b693-e013e77e65f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:55.206876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1318/2661] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:55 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:55.211551 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dce47-042e-42ea-87c1-51b77c38ca2d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:55.271336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dce47-042e-42ea-87c1-51b77c38ca2d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:55.276165 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4560222-8198-424a-912f-cbd4705e2376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:55.276746 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560222-8198-424a-912f-cbd4705e2376 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.277029 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560222-8198-424a-912f-cbd4705e2376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.277305 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560222-8198-424a-912f-cbd4705e2376 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.278012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4560222-8198-424a-912f-cbd4705e2376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:55.279941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4560222-8198-424a-912f-cbd4705e2376 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:55.304907 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1344/2662] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:15:55 2021] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:15:55.308693 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a299ad-3c09-4452-b693-e013e77e65f9 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:55.319347 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a299ad-3c09-4452-b693-e013e77e65f9 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:55.373373 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213b90f-c1bd-40c2-bf9b-0587bfb3eade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:55.374024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213b90f-c1bd-40c2-bf9b-0587bfb3eade admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.374339 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213b90f-c1bd-40c2-bf9b-0587bfb3eade admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.374643 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213b90f-c1bd-40c2-bf9b-0587bfb3eade admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.375344 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213b90f-c1bd-40c2-bf9b-0587bfb3eade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:55.377242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213b90f-c1bd-40c2-bf9b-0587bfb3eade admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:55.397054 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1319/2663] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:15:55 2021] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:15:55.401027 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4560222-8198-424a-912f-cbd4705e2376 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:55.411830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4560222-8198-424a-912f-cbd4705e2376 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:55.416829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a175b6-dea0-466c-af9c-ec4a0c460081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:55.417484 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a175b6-dea0-466c-af9c-ec4a0c460081 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.417768 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a175b6-dea0-466c-af9c-ec4a0c460081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.418046 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a175b6-dea0-466c-af9c-ec4a0c460081 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.418818 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a175b6-dea0-466c-af9c-ec4a0c460081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:55.420421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a175b6-dea0-466c-af9c-ec4a0c460081 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:55.431543 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1345/2664] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:15:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:15:55.435599 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213b90f-c1bd-40c2-bf9b-0587bfb3eade admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:55.445997 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213b90f-c1bd-40c2-bf9b-0587bfb3eade admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:55.450521 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eebb9f-ce5d-419c-bbe0-83f801ba82ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:55.451380 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eebb9f-ce5d-419c-bbe0-83f801ba82ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.451656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eebb9f-ce5d-419c-bbe0-83f801ba82ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.451930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eebb9f-ce5d-419c-bbe0-83f801ba82ea admin admin] PATH_INFO: `/v3/projects/0749de8963df429883b06e1a27ec769c/users/480eff96210747d09bda56d02f8789dc/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.466812 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eebb9f-ce5d-419c-bbe0-83f801ba82ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0749de8963df429883b06e1a27ec769c, user_id=480eff96210747d09bda56d02f8789dc, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:55.469469 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eebb9f-ce5d-419c-bbe0-83f801ba82ea admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:55.481691 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1320/2665] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:15:55 2021] PUT /identity/v3/projects/0749de8963df429883b06e1a27ec769c/users/480eff96210747d09bda56d02f8789dc/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:55.486056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a175b6-dea0-466c-af9c-ec4a0c460081 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:55.495919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a175b6-dea0-466c-af9c-ec4a0c460081 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:55.552486 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c287a-8ba6-44fe-ae34-b75549c2c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:55.553145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c287a-8ba6-44fe-ae34-b75549c2c5cb admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.553419 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c287a-8ba6-44fe-ae34-b75549c2c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.553699 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c287a-8ba6-44fe-ae34-b75549c2c5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.554459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c287a-8ba6-44fe-ae34-b75549c2c5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:55.556046 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c287a-8ba6-44fe-ae34-b75549c2c5cb admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:55.567035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1346/2666] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:15:55 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:15:55.571062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eebb9f-ce5d-419c-bbe0-83f801ba82ea admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:55.582838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eebb9f-ce5d-419c-bbe0-83f801ba82ea admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:55.587667 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c70fe-7251-4af3-bae2-87e9069dba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:55.588561 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c70fe-7251-4af3-bae2-87e9069dba3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.588868 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c70fe-7251-4af3-bae2-87e9069dba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.589144 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c70fe-7251-4af3-bae2-87e9069dba3b admin admin] PATH_INFO: `/v3/projects/0749de8963df429883b06e1a27ec769c/users/480eff96210747d09bda56d02f8789dc/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.591164 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c70fe-7251-4af3-bae2-87e9069dba3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0749de8963df429883b06e1a27ec769c, user_id=480eff96210747d09bda56d02f8789dc, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:55.594453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c70fe-7251-4af3-bae2-87e9069dba3b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:55.604914 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1321/2667] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:15:55 2021] PUT /identity/v3/projects/0749de8963df429883b06e1a27ec769c/users/480eff96210747d09bda56d02f8789dc/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:15:55.615737 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3be1f-7897-4d39-a43a-7b4e053cd1f6 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.615881 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3be1f-7897-4d39-a43a-7b4e053cd1f6 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.616345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3be1f-7897-4d39-a43a-7b4e053cd1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.644925 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-72a3be1f-7897-4d39-a43a-7b4e053cd1f6 None None] MFA Rules not processed for user `480eff96210747d09bda56d02f8789dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:55.646140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-72a3be1f-7897-4d39-a43a-7b4e053cd1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:55.714748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1347/2668] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:55 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:55.725905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c70fe-7251-4af3-bae2-87e9069dba3b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:55.727648 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-254c70fe-7251-4af3-bae2-87e9069dba3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:55.782929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c70fe-7251-4af3-bae2-87e9069dba3b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:55.786431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582658ed-637e-4e3e-a702-c221f9502e30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:55.787060 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582658ed-637e-4e3e-a702-c221f9502e30 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.787338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582658ed-637e-4e3e-a702-c221f9502e30 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.787611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582658ed-637e-4e3e-a702-c221f9502e30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.798483 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582658ed-637e-4e3e-a702-c221f9502e30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:55.799927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582658ed-637e-4e3e-a702-c221f9502e30 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:55.809637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1322/2669] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:15:55 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:15:55.895943 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3be1f-7897-4d39-a43a-7b4e053cd1f6 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:55.906175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3be1f-7897-4d39-a43a-7b4e053cd1f6 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:55.909762 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b431d2-787e-4bff-9629-92e2242caa51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:55.910413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b431d2-787e-4bff-9629-92e2242caa51 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:55.910694 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b431d2-787e-4bff-9629-92e2242caa51 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:55.911190 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b431d2-787e-4bff-9629-92e2242caa51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:55.966703 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b431d2-787e-4bff-9629-92e2242caa51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:55.968218 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b431d2-787e-4bff-9629-92e2242caa51 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:55.976908 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1348/2670] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:15:55 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:15:56.217078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582658ed-637e-4e3e-a702-c221f9502e30 service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:56.276116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582658ed-637e-4e3e-a702-c221f9502e30 service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:56.281195 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:56.282204 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:56.282499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:56.282777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] PATH_INFO: `/v3/users/a3b3498f48be40c6865d095702f74f52` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:56.284002 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b3498f48be40c6865d095702f74f52)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:56.285955 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:56.331676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b3498f48be40c6865d095702f74f52'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:56.338773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b3498f48be40c6865d095702f74f52'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:56.339670 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b3498f48be40c6865d095702f74f52'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:56.340292 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b3498f48be40c6865d095702f74f52'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:56.352473 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b3498f48be40c6865d095702f74f52'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:56.365776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1323/2671] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:15:56 2021] DELETE /identity/v3/users/a3b3498f48be40c6865d095702f74f52 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:56.370359 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f92845-7a01-42d1-bee9-9e3530651107 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:56.370706 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f92845-7a01-42d1-bee9-9e3530651107 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:56.370987 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f92845-7a01-42d1-bee9-9e3530651107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:56.388504 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-48f92845-7a01-42d1-bee9-9e3530651107 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:56.389771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-48f92845-7a01-42d1-bee9-9e3530651107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:56.450991 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1349/2672] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:56.461160 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:56.462882 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:56.522555 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7851-985e-4cad-bb9d-d5b0226b6db9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:56.526204 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6fe80-b214-4b99-a839-89fd9807f8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:56.526895 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6fe80-b214-4b99-a839-89fd9807f8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:56.527175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6fe80-b214-4b99-a839-89fd9807f8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:56.527447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6fe80-b214-4b99-a839-89fd9807f8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:56.538249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6fe80-b214-4b99-a839-89fd9807f8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:56.539674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6fe80-b214-4b99-a839-89fd9807f8d2 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:56.550726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1324/2673] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:15:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:15:56.900394 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f92845-7a01-42d1-bee9-9e3530651107 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:56.901928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-48f92845-7a01-42d1-bee9-9e3530651107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:56.914213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f92845-7a01-42d1-bee9-9e3530651107 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:56.919056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:56.919975 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:56.920204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:56.920479 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] PATH_INFO: `/v3/projects/4c5eee839ac54b17be4dfc29a6f2fd79` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:56.922041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5eee839ac54b17be4dfc29a6f2fd79)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:56.924037 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:56.972457 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5eee839ac54b17be4dfc29a6f2fd79', 'request_id': 'req-bf01cd62-5140-494c-a795-2e8b02ca2d8a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:56.978652 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5eee839ac54b17be4dfc29a6f2fd79', 'request_id': 'req-bf01cd62-5140-494c-a795-2e8b02ca2d8a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:56.986604 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5eee839ac54b17be4dfc29a6f2fd79', 'request_id': 'req-bf01cd62-5140-494c-a795-2e8b02ca2d8a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:56.996343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] The token cache is being invalidate because project 4c5eee839ac54b17be4dfc29a6f2fd79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:15:56.996630 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:56.997245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:56.998806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1350/2674] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:15:56 2021] DELETE /identity/v3/projects/4c5eee839ac54b17be4dfc29a6f2fd79 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:57.003832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6fe80-b214-4b99-a839-89fd9807f8d2 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:57.013595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6fe80-b214-4b99-a839-89fd9807f8d2 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:57.079972 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11890be0-0f8d-4e94-91b9-ea5bb7b67cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:57.080739 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11890be0-0f8d-4e94-91b9-ea5bb7b67cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:57.081016 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11890be0-0f8d-4e94-91b9-ea5bb7b67cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:57.081284 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11890be0-0f8d-4e94-91b9-ea5bb7b67cbc admin admin] PATH_INFO: `/v3/users/480eff96210747d09bda56d02f8789dc` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:57.082489 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11890be0-0f8d-4e94-91b9-ea5bb7b67cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=480eff96210747d09bda56d02f8789dc)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:57.084377 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11890be0-0f8d-4e94-91b9-ea5bb7b67cbc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:57.128302 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-11890be0-0f8d-4e94-91b9-ea5bb7b67cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480eff96210747d09bda56d02f8789dc'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:57.134847 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-11890be0-0f8d-4e94-91b9-ea5bb7b67cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480eff96210747d09bda56d02f8789dc'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:57.135496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-11890be0-0f8d-4e94-91b9-ea5bb7b67cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480eff96210747d09bda56d02f8789dc'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:57.136743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-11890be0-0f8d-4e94-91b9-ea5bb7b67cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480eff96210747d09bda56d02f8789dc'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:57.148694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-11890be0-0f8d-4e94-91b9-ea5bb7b67cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480eff96210747d09bda56d02f8789dc'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:57.161753 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1325/2675] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:15:57 2021] DELETE /identity/v3/users/480eff96210747d09bda56d02f8789dc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:57.426578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:57.428061 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:57.441987 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01cd62-5140-494c-a795-2e8b02ca2d8a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:57.496086 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d993aa5-2503-418c-8ea8-f81e220b46a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:57.496935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d993aa5-2503-418c-8ea8-f81e220b46a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:57.497215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d993aa5-2503-418c-8ea8-f81e220b46a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:57.497488 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d993aa5-2503-418c-8ea8-f81e220b46a3 admin admin] PATH_INFO: `/v3/projects/0749de8963df429883b06e1a27ec769c` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:57.498702 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d993aa5-2503-418c-8ea8-f81e220b46a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0749de8963df429883b06e1a27ec769c)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:57.501240 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d993aa5-2503-418c-8ea8-f81e220b46a3 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:57.544606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4d993aa5-2503-418c-8ea8-f81e220b46a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0749de8963df429883b06e1a27ec769c', 'request_id': 'req-4d993aa5-2503-418c-8ea8-f81e220b46a3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:57.551269 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4d993aa5-2503-418c-8ea8-f81e220b46a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0749de8963df429883b06e1a27ec769c', 'request_id': 'req-4d993aa5-2503-418c-8ea8-f81e220b46a3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:57.558244 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4d993aa5-2503-418c-8ea8-f81e220b46a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0749de8963df429883b06e1a27ec769c', 'request_id': 'req-4d993aa5-2503-418c-8ea8-f81e220b46a3'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:57.568996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4d993aa5-2503-418c-8ea8-f81e220b46a3 admin admin] The token cache is being invalidate because project 0749de8963df429883b06e1a27ec769c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:15:57.569320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4d993aa5-2503-418c-8ea8-f81e220b46a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:57.570090 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-4d993aa5-2503-418c-8ea8-f81e220b46a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:57.572929 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1351/2676] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:15:57 2021] DELETE /identity/v3/projects/0749de8963df429883b06e1a27ec769c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:57.579438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4b5de-c096-474e-b961-c5d8c115e7bd None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:57.579727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4b5de-c096-474e-b961-c5d8c115e7bd None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:57.580007 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4b5de-c096-474e-b961-c5d8c115e7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:57.598864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-2ca4b5de-c096-474e-b961-c5d8c115e7bd None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:57.600128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-2ca4b5de-c096-474e-b961-c5d8c115e7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:57.659266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1326/2677] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:57.667043 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23758f-1bc0-4e18-ba43-21ecb566b602 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:57.667356 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23758f-1bc0-4e18-ba43-21ecb566b602 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:57.667636 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23758f-1bc0-4e18-ba43-21ecb566b602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:57.685784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-fc23758f-1bc0-4e18-ba43-21ecb566b602 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:57.687969 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fc23758f-1bc0-4e18-ba43-21ecb566b602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:57.695829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1352/2678] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:57.699835 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4b5de-c096-474e-b961-c5d8c115e7bd None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:57.710098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4b5de-c096-474e-b961-c5d8c115e7bd None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:57.714946 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b517d-4e88-48d0-8eb6-42023d795a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:57.715588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b517d-4e88-48d0-8eb6-42023d795a82 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:57.715870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b517d-4e88-48d0-8eb6-42023d795a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:57.716147 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b517d-4e88-48d0-8eb6-42023d795a82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:57.716873 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b517d-4e88-48d0-8eb6-42023d795a82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:15:57.717181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b517d-4e88-48d0-8eb6-42023d795a82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:57.719442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b517d-4e88-48d0-8eb6-42023d795a82 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:57.732360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1327/2679] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:15:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:15:57.736954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23758f-1bc0-4e18-ba43-21ecb566b602 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:57.745884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23758f-1bc0-4e18-ba43-21ecb566b602 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:57.751497 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a266d14-6477-4135-b6ba-7c4e5304f190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:57.752137 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a266d14-6477-4135-b6ba-7c4e5304f190 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:57.752421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a266d14-6477-4135-b6ba-7c4e5304f190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:57.752695 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a266d14-6477-4135-b6ba-7c4e5304f190 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:57.753386 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a266d14-6477-4135-b6ba-7c4e5304f190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:57.755303 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a266d14-6477-4135-b6ba-7c4e5304f190 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:57.782592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1353/2680] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:15:57 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:15:57.785993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b517d-4e88-48d0-8eb6-42023d795a82 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:57.795831 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b517d-4e88-48d0-8eb6-42023d795a82 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:57.850271 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8095a8-51e3-411d-84c0-ab10cc0ceb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:57.850915 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8095a8-51e3-411d-84c0-ab10cc0ceb4c admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:57.851202 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8095a8-51e3-411d-84c0-ab10cc0ceb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:57.851478 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8095a8-51e3-411d-84c0-ab10cc0ceb4c admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:57.852193 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8095a8-51e3-411d-84c0-ab10cc0ceb4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:57.854100 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8095a8-51e3-411d-84c0-ab10cc0ceb4c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:57.872788 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1328/2681] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:15:57 2021] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:15:57.877418 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a266d14-6477-4135-b6ba-7c4e5304f190 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:57.887825 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a266d14-6477-4135-b6ba-7c4e5304f190 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:57.893495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e20b3-80c8-4fe3-aa4a-2669732c439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:57.894153 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e20b3-80c8-4fe3-aa4a-2669732c439b admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:57.894464 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e20b3-80c8-4fe3-aa4a-2669732c439b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:57.894744 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e20b3-80c8-4fe3-aa4a-2669732c439b admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:57.895474 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e20b3-80c8-4fe3-aa4a-2669732c439b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:57.897063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e20b3-80c8-4fe3-aa4a-2669732c439b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:57.908240 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1354/2682] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:15:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:15:57.912270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8095a8-51e3-411d-84c0-ab10cc0ceb4c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:57.922215 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8095a8-51e3-411d-84c0-ab10cc0ceb4c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:57.927097 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15f795-4950-4f5e-b665-785caa15efb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:57.927802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15f795-4950-4f5e-b665-785caa15efb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:57.928086 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15f795-4950-4f5e-b665-785caa15efb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:57.928368 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15f795-4950-4f5e-b665-785caa15efb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:57.929107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15f795-4950-4f5e-b665-785caa15efb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:57.930803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15f795-4950-4f5e-b665-785caa15efb5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:57.941680 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1329/2683] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:15:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:15:57.945945 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e20b3-80c8-4fe3-aa4a-2669732c439b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:57.956974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e20b3-80c8-4fe3-aa4a-2669732c439b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:57.963081 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f951d9-49e4-4890-a834-e407a40fef3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:57.964046 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f951d9-49e4-4890-a834-e407a40fef3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:57.964256 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f951d9-49e4-4890-a834-e407a40fef3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:57.964533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f951d9-49e4-4890-a834-e407a40fef3d admin admin] PATH_INFO: `/v3/projects/9a1f57a4c36042eeb1ba15fe6e314039/users/e639c6565f5e4dcdbe9bcf991db84584/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:57.979701 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f951d9-49e4-4890-a834-e407a40fef3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1f57a4c36042eeb1ba15fe6e314039, user_id=e639c6565f5e4dcdbe9bcf991db84584, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:57.982350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f951d9-49e4-4890-a834-e407a40fef3d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:57.997459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1355/2684] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:15:57 2021] PUT /identity/v3/projects/9a1f57a4c36042eeb1ba15fe6e314039/users/e639c6565f5e4dcdbe9bcf991db84584/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:58.009168 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62aa8e-6c39-49a8-8077-d1b81b60b55e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:58.009700 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62aa8e-6c39-49a8-8077-d1b81b60b55e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:58.010032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62aa8e-6c39-49a8-8077-d1b81b60b55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:58.037994 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-fa62aa8e-6c39-49a8-8077-d1b81b60b55e None None] MFA Rules not processed for user `e639c6565f5e4dcdbe9bcf991db84584`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:58.039254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-fa62aa8e-6c39-49a8-8077-d1b81b60b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:58.106687 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1330/2685] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:58 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:58.117193 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f951d9-49e4-4890-a834-e407a40fef3d admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:58.119026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-19f951d9-49e4-4890-a834-e407a40fef3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:58.176172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f951d9-49e4-4890-a834-e407a40fef3d admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:58.179891 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06b5b5-3966-4b67-9cd1-f72e787c7d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:58.180534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06b5b5-3966-4b67-9cd1-f72e787c7d8a service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:58.180817 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06b5b5-3966-4b67-9cd1-f72e787c7d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:58.181093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06b5b5-3966-4b67-9cd1-f72e787c7d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:58.189384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06b5b5-3966-4b67-9cd1-f72e787c7d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:58.190875 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06b5b5-3966-4b67-9cd1-f72e787c7d8a service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:58.199480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1356/2686] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:15:58 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:15:58.220116 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62aa8e-6c39-49a8-8077-d1b81b60b55e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:58.279199 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62aa8e-6c39-49a8-8077-d1b81b60b55e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:58.284653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:58.285503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:58.285787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:58.286064 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] PATH_INFO: `/v3/users/e639c6565f5e4dcdbe9bcf991db84584` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:58.287282 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e639c6565f5e4dcdbe9bcf991db84584)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:58.289223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:58.333413 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e639c6565f5e4dcdbe9bcf991db84584'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:58.340227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e639c6565f5e4dcdbe9bcf991db84584'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:58.340893 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e639c6565f5e4dcdbe9bcf991db84584'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:58.341534 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e639c6565f5e4dcdbe9bcf991db84584'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:58.353661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e639c6565f5e4dcdbe9bcf991db84584'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:58.368405 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1331/2687] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:15:58 2021] DELETE /identity/v3/users/e639c6565f5e4dcdbe9bcf991db84584 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:15:58.372931 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a31a5-f5fe-4c97-bba1-c99031d0e0dc None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:58.373220 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a31a5-f5fe-4c97-bba1-c99031d0e0dc None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:58.373514 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a31a5-f5fe-4c97-bba1-c99031d0e0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:58.390925 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-285a31a5-f5fe-4c97-bba1-c99031d0e0dc None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:58.392131 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-285a31a5-f5fe-4c97-bba1-c99031d0e0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:58.448845 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1357/2688] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:58.459432 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:58.460856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:58.516072 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2285333-18d6-4613-ac05-8a95c5d1cc59 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:58.519722 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a166360-be49-424c-a702-717d8c226397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:58.520369 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166360-be49-424c-a702-717d8c226397 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:58.520636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166360-be49-424c-a702-717d8c226397 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:58.520915 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166360-be49-424c-a702-717d8c226397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:58.529653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a166360-be49-424c-a702-717d8c226397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:58.531406 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a166360-be49-424c-a702-717d8c226397 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:58.540714 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1332/2689] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:15:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:15:58.805736 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a31a5-f5fe-4c97-bba1-c99031d0e0dc None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:58.807181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-285a31a5-f5fe-4c97-bba1-c99031d0e0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:58.820758 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a31a5-f5fe-4c97-bba1-c99031d0e0dc None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:58.825385 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dcb87-9494-4d75-a4cb-2429f32d27dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:58.826239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dcb87-9494-4d75-a4cb-2429f32d27dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:58.826565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dcb87-9494-4d75-a4cb-2429f32d27dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:58.826843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dcb87-9494-4d75-a4cb-2429f32d27dd admin admin] PATH_INFO: `/v3/projects/9a1f57a4c36042eeb1ba15fe6e314039` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:58.828145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dcb87-9494-4d75-a4cb-2429f32d27dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1f57a4c36042eeb1ba15fe6e314039)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:58.830064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dcb87-9494-4d75-a4cb-2429f32d27dd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:58.876986 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-887dcb87-9494-4d75-a4cb-2429f32d27dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1f57a4c36042eeb1ba15fe6e314039', 'request_id': 'req-887dcb87-9494-4d75-a4cb-2429f32d27dd'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:58.883318 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-887dcb87-9494-4d75-a4cb-2429f32d27dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1f57a4c36042eeb1ba15fe6e314039', 'request_id': 'req-887dcb87-9494-4d75-a4cb-2429f32d27dd'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:58.890744 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-887dcb87-9494-4d75-a4cb-2429f32d27dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1f57a4c36042eeb1ba15fe6e314039', 'request_id': 'req-887dcb87-9494-4d75-a4cb-2429f32d27dd'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:58.900979 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-887dcb87-9494-4d75-a4cb-2429f32d27dd admin admin] The token cache is being invalidate because project 9a1f57a4c36042eeb1ba15fe6e314039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:15:58.901292 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-887dcb87-9494-4d75-a4cb-2429f32d27dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:58.901963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-887dcb87-9494-4d75-a4cb-2429f32d27dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:15:58.903536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1358/2690] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:15:58 2021] DELETE /identity/v3/projects/9a1f57a4c36042eeb1ba15fe6e314039 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:58.910941 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207edf1f-f022-4c3d-a323-6dbd8073d79f None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:58.911238 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207edf1f-f022-4c3d-a323-6dbd8073d79f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:58.911520 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207edf1f-f022-4c3d-a323-6dbd8073d79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:58.929544 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-207edf1f-f022-4c3d-a323-6dbd8073d79f None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:58.930811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-207edf1f-f022-4c3d-a323-6dbd8073d79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:58.988726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1333/2691] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:58.996720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed2db7-b7b8-4534-8943-0d7ffe62f9db None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:58.997199 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed2db7-b7b8-4534-8943-0d7ffe62f9db None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:58.997306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed2db7-b7b8-4534-8943-0d7ffe62f9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:59.017860 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-5aed2db7-b7b8-4534-8943-0d7ffe62f9db None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:59.019094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5aed2db7-b7b8-4534-8943-0d7ffe62f9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:59.026973 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1359/2692] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:59.031604 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207edf1f-f022-4c3d-a323-6dbd8073d79f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:59.041422 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207edf1f-f022-4c3d-a323-6dbd8073d79f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:59.045921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1141c-91f9-4a62-9b45-23f80f3bd189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:59.047175 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1141c-91f9-4a62-9b45-23f80f3bd189 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:59.047458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1141c-91f9-4a62-9b45-23f80f3bd189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:59.047736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1141c-91f9-4a62-9b45-23f80f3bd189 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:59.048460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1141c-91f9-4a62-9b45-23f80f3bd189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:15:59.048768 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1141c-91f9-4a62-9b45-23f80f3bd189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:59.050380 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1141c-91f9-4a62-9b45-23f80f3bd189 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:59.061588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1334/2693] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:15:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:15:59.066697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed2db7-b7b8-4534-8943-0d7ffe62f9db None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:59.076247 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed2db7-b7b8-4534-8943-0d7ffe62f9db None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:59.081378 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f79b0-75d1-4e17-8838-2ec8d8c689c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:59.082005 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f79b0-75d1-4e17-8838-2ec8d8c689c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:59.082286 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f79b0-75d1-4e17-8838-2ec8d8c689c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:59.082618 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f79b0-75d1-4e17-8838-2ec8d8c689c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:59.083280 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f79b0-75d1-4e17-8838-2ec8d8c689c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:59.085226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f79b0-75d1-4e17-8838-2ec8d8c689c5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:59.111693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1360/2694] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:15:59 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:15:59.115563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1141c-91f9-4a62-9b45-23f80f3bd189 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:59.125764 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1141c-91f9-4a62-9b45-23f80f3bd189 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:59.183556 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e2aaf-b239-44a7-900d-113e5f6e2ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:59.184217 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e2aaf-b239-44a7-900d-113e5f6e2ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:59.184497 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e2aaf-b239-44a7-900d-113e5f6e2ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:59.184768 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e2aaf-b239-44a7-900d-113e5f6e2ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:59.185460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e2aaf-b239-44a7-900d-113e5f6e2ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:59.187416 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e2aaf-b239-44a7-900d-113e5f6e2ce5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:59.207274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1335/2695] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:15:59 2021] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:15:59.211710 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f79b0-75d1-4e17-8838-2ec8d8c689c5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:59.223059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f79b0-75d1-4e17-8838-2ec8d8c689c5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:59.227652 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0264f6-d4ab-4b07-81f1-cf056c25d182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:59.228309 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0264f6-d4ab-4b07-81f1-cf056c25d182 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:59.228592 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0264f6-d4ab-4b07-81f1-cf056c25d182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:59.228868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0264f6-d4ab-4b07-81f1-cf056c25d182 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:59.229700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0264f6-d4ab-4b07-81f1-cf056c25d182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:59.231354 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0264f6-d4ab-4b07-81f1-cf056c25d182 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:59.242223 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1361/2696] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:15:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:15:59.245874 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e2aaf-b239-44a7-900d-113e5f6e2ce5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:59.256693 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e2aaf-b239-44a7-900d-113e5f6e2ce5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:59.261731 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cdfd7-f3e3-4212-8c5b-3914db2107df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:59.262504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cdfd7-f3e3-4212-8c5b-3914db2107df admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:59.262791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cdfd7-f3e3-4212-8c5b-3914db2107df admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:59.263076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cdfd7-f3e3-4212-8c5b-3914db2107df admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:59.263796 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cdfd7-f3e3-4212-8c5b-3914db2107df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:59.265373 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cdfd7-f3e3-4212-8c5b-3914db2107df admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:59.276105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1336/2697] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:15:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:15:59.280300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0264f6-d4ab-4b07-81f1-cf056c25d182 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:59.290238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0264f6-d4ab-4b07-81f1-cf056c25d182 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:59.295068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5ffa3-8dd9-4fe0-b82f-7f73e8aa0012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:59.296028 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5ffa3-8dd9-4fe0-b82f-7f73e8aa0012 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:59.296379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5ffa3-8dd9-4fe0-b82f-7f73e8aa0012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:59.296724 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5ffa3-8dd9-4fe0-b82f-7f73e8aa0012 admin admin] PATH_INFO: `/v3/projects/c2dc328b6a5f4dc9a65de6369a17d2a7/users/9cd8e71de14f42b68745748bb2aa87e3/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:59.311228 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5ffa3-8dd9-4fe0-b82f-7f73e8aa0012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dc328b6a5f4dc9a65de6369a17d2a7, user_id=9cd8e71de14f42b68745748bb2aa87e3, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:59.314657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5ffa3-8dd9-4fe0-b82f-7f73e8aa0012 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:59.328515 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1362/2698] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:15:59 2021] PUT /identity/v3/projects/c2dc328b6a5f4dc9a65de6369a17d2a7/users/9cd8e71de14f42b68745748bb2aa87e3/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:15:59.340341 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcef24a-0730-4966-a95b-567a4c79be65 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:59.340702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcef24a-0730-4966-a95b-567a4c79be65 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:59.341113 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcef24a-0730-4966-a95b-567a4c79be65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:59.369172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-5bcef24a-0730-4966-a95b-567a4c79be65 None None] MFA Rules not processed for user `9cd8e71de14f42b68745748bb2aa87e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:15:59.370429 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5bcef24a-0730-4966-a95b-567a4c79be65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:59.433115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1337/2699] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:15:59 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:15:59.443396 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5ffa3-8dd9-4fe0-b82f-7f73e8aa0012 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:15:59.445192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-89a5ffa3-8dd9-4fe0-b82f-7f73e8aa0012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:15:59.501142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5ffa3-8dd9-4fe0-b82f-7f73e8aa0012 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:15:59.504918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a85f20-9697-47cf-af24-aa857b2e371f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:15:59.505559 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a85f20-9697-47cf-af24-aa857b2e371f service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:15:59.505843 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a85f20-9697-47cf-af24-aa857b2e371f service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:15:59.506119 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a85f20-9697-47cf-af24-aa857b2e371f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:15:59.514555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a85f20-9697-47cf-af24-aa857b2e371f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:15:59.515996 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a85f20-9697-47cf-af24-aa857b2e371f service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:15:59.525881 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1363/2700] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:15:59 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:16:09.078147 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcef24a-0730-4966-a95b-567a4c79be65 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:09.139415 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcef24a-0730-4966-a95b-567a4c79be65 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:09.144425 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:09.145285 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:09.145549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:09.145820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] PATH_INFO: `/v3/users/9cd8e71de14f42b68745748bb2aa87e3` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:09.147009 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd8e71de14f42b68745748bb2aa87e3)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:09.148940 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:09.198107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd8e71de14f42b68745748bb2aa87e3'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:16:09.205104 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd8e71de14f42b68745748bb2aa87e3'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:16:09.205780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd8e71de14f42b68745748bb2aa87e3'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:16:09.206419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd8e71de14f42b68745748bb2aa87e3'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:16:09.218499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd8e71de14f42b68745748bb2aa87e3'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:16:09.232286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1338/2701] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:16:09 2021] DELETE /identity/v3/users/9cd8e71de14f42b68745748bb2aa87e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:16:09.237771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1c63-f27f-47c0-b761-876e91b8e3db None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:09.238266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1c63-f27f-47c0-b761-876e91b8e3db None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:09.238404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1c63-f27f-47c0-b761-876e91b8e3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:09.255047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-c0bf1c63-f27f-47c0-b761-876e91b8e3db None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:16:09.256240 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c0bf1c63-f27f-47c0-b761-876e91b8e3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:09.313928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1364/2702] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:16:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:16:09.323704 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:09.325107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:09.379679 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8401f18-7418-4662-a936-e2bf4ae281eb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:09.383349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebf5f6-1d55-4408-ae94-5bb10a7f707f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:09.383980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebf5f6-1d55-4408-ae94-5bb10a7f707f service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:09.384263 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebf5f6-1d55-4408-ae94-5bb10a7f707f service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:09.384551 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebf5f6-1d55-4408-ae94-5bb10a7f707f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:09.394071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebf5f6-1d55-4408-ae94-5bb10a7f707f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:09.395523 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebf5f6-1d55-4408-ae94-5bb10a7f707f service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:09.404664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1339/2703] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:16:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:16:09.665816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf1c63-f27f-47c0-b761-876e91b8e3db None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:09.667440 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-c0bf1c63-f27f-47c0-b761-876e91b8e3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:09.679714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf1c63-f27f-47c0-b761-876e91b8e3db None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:09.684350 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7724cec-13ff-4a32-b2d7-1ab79683df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:09.685226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7724cec-13ff-4a32-b2d7-1ab79683df71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:09.685496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7724cec-13ff-4a32-b2d7-1ab79683df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:09.685772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7724cec-13ff-4a32-b2d7-1ab79683df71 admin admin] PATH_INFO: `/v3/projects/c2dc328b6a5f4dc9a65de6369a17d2a7` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:09.687011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7724cec-13ff-4a32-b2d7-1ab79683df71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2dc328b6a5f4dc9a65de6369a17d2a7)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:09.689697 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7724cec-13ff-4a32-b2d7-1ab79683df71 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:09.739039 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-f7724cec-13ff-4a32-b2d7-1ab79683df71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2dc328b6a5f4dc9a65de6369a17d2a7', 'request_id': 'req-f7724cec-13ff-4a32-b2d7-1ab79683df71'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:16:09.744930 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-f7724cec-13ff-4a32-b2d7-1ab79683df71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2dc328b6a5f4dc9a65de6369a17d2a7', 'request_id': 'req-f7724cec-13ff-4a32-b2d7-1ab79683df71'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:16:09.752796 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-f7724cec-13ff-4a32-b2d7-1ab79683df71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2dc328b6a5f4dc9a65de6369a17d2a7', 'request_id': 'req-f7724cec-13ff-4a32-b2d7-1ab79683df71'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:16:09.767607 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-f7724cec-13ff-4a32-b2d7-1ab79683df71 admin admin] The token cache is being invalidate because project c2dc328b6a5f4dc9a65de6369a17d2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:16:09.767893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-f7724cec-13ff-4a32-b2d7-1ab79683df71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:16:09.768518 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-f7724cec-13ff-4a32-b2d7-1ab79683df71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:16:09.770032 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1365/2704] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:16:09 2021] DELETE /identity/v3/projects/c2dc328b6a5f4dc9a65de6369a17d2a7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:16:09.776019 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef836b9-fac0-4154-b9b1-56f8064a0c04 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:09.776306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef836b9-fac0-4154-b9b1-56f8064a0c04 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:09.776582 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef836b9-fac0-4154-b9b1-56f8064a0c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:09.793825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-4ef836b9-fac0-4154-b9b1-56f8064a0c04 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:16:09.795075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4ef836b9-fac0-4154-b9b1-56f8064a0c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:09.857482 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1340/2705] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:16:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:16:09.865816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fe1ad-7b39-49db-ae31-a481554208c9 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:09.866109 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fe1ad-7b39-49db-ae31-a481554208c9 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:09.866424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fe1ad-7b39-49db-ae31-a481554208c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:09.884929 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-309fe1ad-7b39-49db-ae31-a481554208c9 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:16:09.886127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-309fe1ad-7b39-49db-ae31-a481554208c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:09.894747 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1366/2706] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:16:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:16:09.898826 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef836b9-fac0-4154-b9b1-56f8064a0c04 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:09.908480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef836b9-fac0-4154-b9b1-56f8064a0c04 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:09.912987 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc732739-5d00-41a7-9488-e2bce45d9fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:09.913624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc732739-5d00-41a7-9488-e2bce45d9fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:09.913900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc732739-5d00-41a7-9488-e2bce45d9fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:09.914170 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc732739-5d00-41a7-9488-e2bce45d9fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:09.914924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc732739-5d00-41a7-9488-e2bce45d9fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:16:09.915272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc732739-5d00-41a7-9488-e2bce45d9fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:09.916788 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc732739-5d00-41a7-9488-e2bce45d9fe4 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:09.927920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1341/2707] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:16:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 01:16:09.932006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fe1ad-7b39-49db-ae31-a481554208c9 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:09.941583 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fe1ad-7b39-49db-ae31-a481554208c9 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:09.946150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dd162-f1c9-4fd2-a3c2-25efaa667b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:09.946824 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dd162-f1c9-4fd2-a3c2-25efaa667b40 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:09.947103 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dd162-f1c9-4fd2-a3c2-25efaa667b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:09.947371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dd162-f1c9-4fd2-a3c2-25efaa667b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:09.948070 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dd162-f1c9-4fd2-a3c2-25efaa667b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:09.949948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dd162-f1c9-4fd2-a3c2-25efaa667b40 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:09.976246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1367/2708] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:16:09 2021] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:16:09.979830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc732739-5d00-41a7-9488-e2bce45d9fe4 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:09.990115 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc732739-5d00-41a7-9488-e2bce45d9fe4 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:10.043649 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4ab23-0807-4061-80de-d5fb14804509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:10.044306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4ab23-0807-4061-80de-d5fb14804509 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:10.044615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4ab23-0807-4061-80de-d5fb14804509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:10.044890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4ab23-0807-4061-80de-d5fb14804509 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:10.045597 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4ab23-0807-4061-80de-d5fb14804509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:10.048113 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4ab23-0807-4061-80de-d5fb14804509 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:10.069883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1342/2709] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:16:09 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:16:10.071319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dd162-f1c9-4fd2-a3c2-25efaa667b40 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:10.081426 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dd162-f1c9-4fd2-a3c2-25efaa667b40 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:10.086262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebbd1a-f4f4-42b1-a1cc-21f843a48b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:10.086938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebbd1a-f4f4-42b1-a1cc-21f843a48b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:10.087302 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebbd1a-f4f4-42b1-a1cc-21f843a48b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:10.087577 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebbd1a-f4f4-42b1-a1cc-21f843a48b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:10.088307 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebbd1a-f4f4-42b1-a1cc-21f843a48b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:10.089895 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebbd1a-f4f4-42b1-a1cc-21f843a48b9c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:10.100462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1368/2710] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:16:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:16:10.104412 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4ab23-0807-4061-80de-d5fb14804509 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:10.115076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4ab23-0807-4061-80de-d5fb14804509 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:10.119573 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce69398-e623-45e5-ac66-cee39b4d5130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:10.120212 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce69398-e623-45e5-ac66-cee39b4d5130 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:10.120496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce69398-e623-45e5-ac66-cee39b4d5130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:10.120775 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce69398-e623-45e5-ac66-cee39b4d5130 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:10.121509 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce69398-e623-45e5-ac66-cee39b4d5130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:10.123129 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce69398-e623-45e5-ac66-cee39b4d5130 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:10.133754 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1343/2711] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:16:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:16:10.137693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebbd1a-f4f4-42b1-a1cc-21f843a48b9c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:10.147656 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebbd1a-f4f4-42b1-a1cc-21f843a48b9c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:10.152266 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b797e-4a8c-4a79-8a5f-ce639bac095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:10.153130 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b797e-4a8c-4a79-8a5f-ce639bac095b admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:10.153414 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b797e-4a8c-4a79-8a5f-ce639bac095b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:10.153692 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b797e-4a8c-4a79-8a5f-ce639bac095b admin admin] PATH_INFO: `/v3/projects/7480e21bc2664d4e94526980995f0f6c/users/145783b498ca431aab3f9fe0c958e60a/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:10.167728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b797e-4a8c-4a79-8a5f-ce639bac095b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7480e21bc2664d4e94526980995f0f6c, user_id=145783b498ca431aab3f9fe0c958e60a, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:10.170355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b797e-4a8c-4a79-8a5f-ce639bac095b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:10.183288 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1369/2712] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:16:10 2021] PUT /identity/v3/projects/7480e21bc2664d4e94526980995f0f6c/users/145783b498ca431aab3f9fe0c958e60a/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:16:10.188960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a049-8891-4f79-aafb-bfbca0f9ef5b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:10.189438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a049-8891-4f79-aafb-bfbca0f9ef5b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:10.189735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a049-8891-4f79-aafb-bfbca0f9ef5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:10.207499 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-8361a049-8891-4f79-aafb-bfbca0f9ef5b None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:16:10.208738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-8361a049-8891-4f79-aafb-bfbca0f9ef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:10.266057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1344/2713] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:16:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:16:10.276108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b797e-4a8c-4a79-8a5f-ce639bac095b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:10.277765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6f6b797e-4a8c-4a79-8a5f-ce639bac095b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:10.334937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b797e-4a8c-4a79-8a5f-ce639bac095b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:10.338888 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f2396-35ff-44c0-bbe3-777bbf1dee54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:10.339536 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f2396-35ff-44c0-bbe3-777bbf1dee54 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:10.339820 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f2396-35ff-44c0-bbe3-777bbf1dee54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:10.340096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f2396-35ff-44c0-bbe3-777bbf1dee54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:10.349365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f2396-35ff-44c0-bbe3-777bbf1dee54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:10.350869 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f2396-35ff-44c0-bbe3-777bbf1dee54 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:10.360450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1370/2714] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:16:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:16:14.306103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fafc9-b554-49aa-b2df-f2d2aa3a0e16 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:14.307023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fafc9-b554-49aa-b2df-f2d2aa3a0e16 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:14.307470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fafc9-b554-49aa-b2df-f2d2aa3a0e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:14.334964 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-4a9fafc9-b554-49aa-b2df-f2d2aa3a0e16 None None] MFA Rules not processed for user `145783b498ca431aab3f9fe0c958e60a`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:16:14.336510 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-4a9fafc9-b554-49aa-b2df-f2d2aa3a0e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:14.401919 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1345/2715] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:16:14 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:16:14.406496 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f2396-35ff-44c0-bbe3-777bbf1dee54 service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:14.429098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f2396-35ff-44c0-bbe3-777bbf1dee54 service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:14.434404 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4ce30-611f-4203-8948-5bda90e040e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:14.435293 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4ce30-611f-4203-8948-5bda90e040e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:14.435574 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4ce30-611f-4203-8948-5bda90e040e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:14.435848 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4ce30-611f-4203-8948-5bda90e040e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:14.436562 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4ce30-611f-4203-8948-5bda90e040e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:14.438806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4ce30-611f-4203-8948-5bda90e040e4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:14.465720 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1371/2716] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:16:14 2021] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:16:14.470701 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fafc9-b554-49aa-b2df-f2d2aa3a0e16 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:14.482239 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fafc9-b554-49aa-b2df-f2d2aa3a0e16 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:14.542592 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934630f4-f574-4dac-9fb9-35edf2bc9e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:14.543254 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934630f4-f574-4dac-9fb9-35edf2bc9e60 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:14.543611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934630f4-f574-4dac-9fb9-35edf2bc9e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:14.544076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934630f4-f574-4dac-9fb9-35edf2bc9e60 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:14.545167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934630f4-f574-4dac-9fb9-35edf2bc9e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:14.547479 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934630f4-f574-4dac-9fb9-35edf2bc9e60 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:14.569151 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1346/2717] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:16:14 2021] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:16:14.573145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4ce30-611f-4203-8948-5bda90e040e4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:14.584192 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4ce30-611f-4203-8948-5bda90e040e4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:14.589262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad7870-aab0-4a8f-b3e6-d72ac611627c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:14.589864 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad7870-aab0-4a8f-b3e6-d72ac611627c admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:14.590142 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad7870-aab0-4a8f-b3e6-d72ac611627c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:14.590447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad7870-aab0-4a8f-b3e6-d72ac611627c admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:14.591179 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad7870-aab0-4a8f-b3e6-d72ac611627c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:14.592755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad7870-aab0-4a8f-b3e6-d72ac611627c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:14.604516 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1372/2718] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:16:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:16:14.608642 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934630f4-f574-4dac-9fb9-35edf2bc9e60 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:14.618961 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934630f4-f574-4dac-9fb9-35edf2bc9e60 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:14.623807 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1bc42-f880-4f4c-91cd-cb8761ac0f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:14.624695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1bc42-f880-4f4c-91cd-cb8761ac0f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:14.624973 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1bc42-f880-4f4c-91cd-cb8761ac0f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:14.625250 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1bc42-f880-4f4c-91cd-cb8761ac0f10 admin admin] PATH_INFO: `/v3/projects/d31e005e5dc549e5b246863e835dcdc5/users/7d43084ca280496b94559ddc3bb2cf27/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:14.642656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1bc42-f880-4f4c-91cd-cb8761ac0f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31e005e5dc549e5b246863e835dcdc5, user_id=7d43084ca280496b94559ddc3bb2cf27, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:14.645334 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1bc42-f880-4f4c-91cd-cb8761ac0f10 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:14.660149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1347/2719] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:16:14 2021] PUT /identity/v3/projects/d31e005e5dc549e5b246863e835dcdc5/users/7d43084ca280496b94559ddc3bb2cf27/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:16:14.663779 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad7870-aab0-4a8f-b3e6-d72ac611627c admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:14.675364 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad7870-aab0-4a8f-b3e6-d72ac611627c admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:14.739391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448bb9-626d-42d1-8ea6-74ee393c1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:14.740191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448bb9-626d-42d1-8ea6-74ee393c1d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:14.740540 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448bb9-626d-42d1-8ea6-74ee393c1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:14.740880 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448bb9-626d-42d1-8ea6-74ee393c1d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:14.741714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9448bb9-626d-42d1-8ea6-74ee393c1d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:14.743387 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9448bb9-626d-42d1-8ea6-74ee393c1d64 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:14.754128 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1373/2720] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:16:14 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:16:14.758287 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1bc42-f880-4f4c-91cd-cb8761ac0f10 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:14.770189 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1bc42-f880-4f4c-91cd-cb8761ac0f10 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:14.775869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab914d1-c8be-4028-9568-06622071d3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:14.776925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab914d1-c8be-4028-9568-06622071d3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:14.777339 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab914d1-c8be-4028-9568-06622071d3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:14.777694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab914d1-c8be-4028-9568-06622071d3ab admin admin] PATH_INFO: `/v3/projects/d31e005e5dc549e5b246863e835dcdc5/users/7d43084ca280496b94559ddc3bb2cf27/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:14.783028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab914d1-c8be-4028-9568-06622071d3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31e005e5dc549e5b246863e835dcdc5, user_id=7d43084ca280496b94559ddc3bb2cf27, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:14.788460 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab914d1-c8be-4028-9568-06622071d3ab admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:14.801821 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1348/2721] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:16:14 2021] PUT /identity/v3/projects/d31e005e5dc549e5b246863e835dcdc5/users/7d43084ca280496b94559ddc3bb2cf27/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:16:19.436591 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac9fd7-ffbf-43eb-906b-590ea291425c None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:19.437379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac9fd7-ffbf-43eb-906b-590ea291425c None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:19.438234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac9fd7-ffbf-43eb-906b-590ea291425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:19.500748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9bac9fd7-ffbf-43eb-906b-590ea291425c None None] MFA Rules not processed for user `7d43084ca280496b94559ddc3bb2cf27`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:16:19.502080 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9bac9fd7-ffbf-43eb-906b-590ea291425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:19.582532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1374/2722] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:16:19 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:16:19.593930 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab914d1-c8be-4028-9568-06622071d3ab admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:19.595814 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-cab914d1-c8be-4028-9568-06622071d3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:19.675522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab914d1-c8be-4028-9568-06622071d3ab admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:19.681547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68b840-8d4c-47c1-b651-47f8a4251120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:19.682214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b840-8d4c-47c1-b651-47f8a4251120 service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:19.682546 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b840-8d4c-47c1-b651-47f8a4251120 service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:19.683000 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b840-8d4c-47c1-b651-47f8a4251120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:19.745240 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68b840-8d4c-47c1-b651-47f8a4251120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:19.746910 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68b840-8d4c-47c1-b651-47f8a4251120 service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:19.757199 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1349/2723] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:16:19 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:16:37.133101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8376757-5afa-40ea-b7c4-b5127459f680 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:37.133683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8376757-5afa-40ea-b7c4-b5127459f680 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:37.133683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8376757-5afa-40ea-b7c4-b5127459f680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:37.152203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e8376757-5afa-40ea-b7c4-b5127459f680 None None] MFA Rules not processed for user `145783b498ca431aab3f9fe0c958e60a`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:16:37.153399 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e8376757-5afa-40ea-b7c4-b5127459f680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:37.161330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1375/2724] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:16:37 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:16:52.629391 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68b840-8d4c-47c1-b651-47f8a4251120 service nova] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:52.630862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-7b68b840-8d4c-47c1-b651-47f8a4251120 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:52.690166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68b840-8d4c-47c1-b651-47f8a4251120 service nova] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:52.693833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99615d0-58d7-4e41-8ec1-23aa9fdde37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:52.694503 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99615d0-58d7-4e41-8ec1-23aa9fdde37c service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:52.694910 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99615d0-58d7-4e41-8ec1-23aa9fdde37c service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:52.695191 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99615d0-58d7-4e41-8ec1-23aa9fdde37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:52.704505 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99615d0-58d7-4e41-8ec1-23aa9fdde37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:52.705954 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99615d0-58d7-4e41-8ec1-23aa9fdde37c service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:52.716179 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1350/2725] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:16:52 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:16:54.750450 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab135894-e245-424b-8570-9880c563d5a4 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:54.751033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab135894-e245-424b-8570-9880c563d5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:54.751935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab135894-e245-424b-8570-9880c563d5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:54.771299 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-ab135894-e245-424b-8570-9880c563d5a4 None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:16:54.772761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-ab135894-e245-424b-8570-9880c563d5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:54.883822 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1376/2726] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:16:54 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:16:54.935399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99615d0-58d7-4e41-8ec1-23aa9fdde37c service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:16:54.937469 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d99615d0-58d7-4e41-8ec1-23aa9fdde37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:16:55.030385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99615d0-58d7-4e41-8ec1-23aa9fdde37c service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:16:55.036722 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551952e-d3c8-4cca-9db8-0194c97f3e92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:16:55.037630 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551952e-d3c8-4cca-9db8-0194c97f3e92 service swift] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:16:55.038210 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551952e-d3c8-4cca-9db8-0194c97f3e92 service swift] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:16:55.038736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551952e-d3c8-4cca-9db8-0194c97f3e92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:16:55.049608 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551952e-d3c8-4cca-9db8-0194c97f3e92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:16:55.051448 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551952e-d3c8-4cca-9db8-0194c97f3e92 service swift] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:16:55.062062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1351/2727] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:16:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 01:17:09.020189 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01c443-9cb3-4ddc-a8c3-0d21d6738e9e None None] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:17:09.020761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01c443-9cb3-4ddc-a8c3-0d21d6738e9e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:17:09.020761 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01c443-9cb3-4ddc-a8c3-0d21d6738e9e None None] PATH_INFO: `/` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:17:09.022763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1377/2728] 10.222.0.23 () {54 vars in 921 bytes} [Thu Dec 9 01:17:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:17:09.031595 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb7080-810a-47ba-abd2-7a9ac1b2975b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:17:09.032123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb7080-810a-47ba-abd2-7a9ac1b2975b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:17:09.032645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb7080-810a-47ba-abd2-7a9ac1b2975b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:17:09.051984 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b4cb7080-810a-47ba-abd2-7a9ac1b2975b None None] MFA Rules not processed for user `53d32ba063bc4a719d4c2f67d88ec640`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:17:09.053211 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b4cb7080-810a-47ba-abd2-7a9ac1b2975b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:17:09.063705 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1352/2729] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Dec 9 01:17:09 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:17:09.076155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01c443-9cb3-4ddc-a8c3-0d21d6738e9e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:17:09.078789 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-1f01c443-9cb3-4ddc-a8c3-0d21d6738e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:17:09.135471 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01c443-9cb3-4ddc-a8c3-0d21d6738e9e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:17:09.139663 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b6c5e-b2a5-4cc7-9af8-0c030f67bf74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d001733477f499e937ba90e7e50ba33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:17:09.140392 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b6c5e-b2a5-4cc7-9af8-0c030f67bf74 service glance] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:17:09.140684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b6c5e-b2a5-4cc7-9af8-0c030f67bf74 service glance] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:17:09.140964 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b6c5e-b2a5-4cc7-9af8-0c030f67bf74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:17:09.159997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b6c5e-b2a5-4cc7-9af8-0c030f67bf74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:17:09.159997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b6c5e-b2a5-4cc7-9af8-0c030f67bf74 service glance] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:17:09.164152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1378/2730] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:17:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:17:09.229565 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f855-655f-4301-af8f-9b9933ad8cf8 None None] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:17:09.229777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f855-655f-4301-af8f-9b9933ad8cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:17:09.230066 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f855-655f-4301-af8f-9b9933ad8cf8 None None] PATH_INFO: `/` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:17:09.231875 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1353/2731] 10.222.0.23 () {54 vars in 921 bytes} [Thu Dec 9 01:17:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 09 01:17:09.237307 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120f98a-1a07-40ed-b094-5dae37fd11be None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:17:09.237618 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120f98a-1a07-40ed-b094-5dae37fd11be None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:17:09.237925 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120f98a-1a07-40ed-b094-5dae37fd11be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:17:09.256349 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9120f98a-1a07-40ed-b094-5dae37fd11be None None] MFA Rules not processed for user `0ab73b6f3a1949359549f91e1b708600`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:17:09.257534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9120f98a-1a07-40ed-b094-5dae37fd11be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:17:09.263868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1379/2732] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Dec 9 01:17:09 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:17:09.276412 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f855-655f-4301-af8f-9b9933ad8cf8 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:17:09.287099 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f855-655f-4301-af8f-9b9933ad8cf8 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:17:09.290526 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcb8ef-5994-43a1-b996-5be1a74204a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:17:09.291141 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcb8ef-5994-43a1-b996-5be1a74204a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:17:09.291419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcb8ef-5994-43a1-b996-5be1a74204a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:17:09.291694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcb8ef-5994-43a1-b996-5be1a74204a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:17:09.299054 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcb8ef-5994-43a1-b996-5be1a74204a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:17:09.300457 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcb8ef-5994-43a1-b996-5be1a74204a4 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:17:09.307825 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1354/2733] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:17:09 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:17:11.307809 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a7b88-63a3-4da5-b5dd-225c746792a7 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:17:11.308279 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a7b88-63a3-4da5-b5dd-225c746792a7 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:17:11.308389 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a7b88-63a3-4da5-b5dd-225c746792a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:17:11.327547 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-645a7b88-63a3-4da5-b5dd-225c746792a7 None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:17:11.328801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-645a7b88-63a3-4da5-b5dd-225c746792a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:17:11.336313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1380/2734] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Dec 9 01:17:11 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:17:11.348547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcb8ef-5994-43a1-b996-5be1a74204a4 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:17:11.361037 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcb8ef-5994-43a1-b996-5be1a74204a4 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:17:11.365992 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27c7de-cb29-4c9a-8e32-2498bf151cfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:17:11.366768 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27c7de-cb29-4c9a-8e32-2498bf151cfb service swift] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:17:11.367124 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27c7de-cb29-4c9a-8e32-2498bf151cfb service swift] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:17:11.368087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27c7de-cb29-4c9a-8e32-2498bf151cfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:17:11.377241 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27c7de-cb29-4c9a-8e32-2498bf151cfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:17:11.378855 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27c7de-cb29-4c9a-8e32-2498bf151cfb service swift] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:17:11.386962 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1355/2735] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:17:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 09 01:17:25.756528 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a7b88-63a3-4da5-b5dd-225c746792a7 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:17:25.757939 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-645a7b88-63a3-4da5-b5dd-225c746792a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:17:25.825023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a7b88-63a3-4da5-b5dd-225c746792a7 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:17:25.830041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb9559-c870-4e51-9ed3-c0068d3998b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cebb33ff7c4e40a06b3c7f1a40823d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:17:25.830702 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9559-c870-4e51-9ed3-c0068d3998b4 service placement] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:17:25.830984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9559-c870-4e51-9ed3-c0068d3998b4 service placement] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:17:25.831253 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9559-c870-4e51-9ed3-c0068d3998b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:17:25.832982 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-dbdb9559-c870-4e51-9ed3-c0068d3998b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:17:25.844414 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb9559-c870-4e51-9ed3-c0068d3998b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:17:25.846026 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb9559-c870-4e51-9ed3-c0068d3998b4 service placement] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:17:25.855997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1381/2736] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:17:25 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:17:30.448195 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62456f-338b-464d-9d0b-4b934ceb83d7 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:17:30.448736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62456f-338b-464d-9d0b-4b934ceb83d7 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:17:30.448736 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62456f-338b-464d-9d0b-4b934ceb83d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:17:30.467541 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-0a62456f-338b-464d-9d0b-4b934ceb83d7 None None] MFA Rules not processed for user `7ccda27976ad40f2a62a50189f0fdc63`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:17:30.468748 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0a62456f-338b-464d-9d0b-4b934ceb83d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:17:30.479388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1356/2737] 10.222.0.23 () {58 vars in 967 bytes} [Thu Dec 9 01:17:30 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:17:30.493371 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb9559-c870-4e51-9ed3-c0068d3998b4 service placement] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:17:30.505997 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb9559-c870-4e51-9ed3-c0068d3998b4 service placement] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:17:30.511172 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69c6eb-d8f8-404b-9122-a19c26169120 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a17190105a4228bdd94926e1a2091e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:17:30.511830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69c6eb-d8f8-404b-9122-a19c26169120 service swift] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:17:30.512115 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69c6eb-d8f8-404b-9122-a19c26169120 service swift] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:17:30.512394 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69c6eb-d8f8-404b-9122-a19c26169120 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:17:30.521462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69c6eb-d8f8-404b-9122-a19c26169120 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:17:30.523183 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69c6eb-d8f8-404b-9122-a19c26169120 service swift] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:17:30.532222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1382/2738] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Dec 9 01:17:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 09 01:18:05.435881 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62456f-338b-464d-9d0b-4b934ceb83d7 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:05.437433 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0a62456f-338b-464d-9d0b-4b934ceb83d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:05.491719 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62456f-338b-464d-9d0b-4b934ceb83d7 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:05.495286 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34b4a7-6096-4473-8b92-3eb4cb66c40e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:05.495914 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34b4a7-6096-4473-8b92-3eb4cb66c40e service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:05.496221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34b4a7-6096-4473-8b92-3eb4cb66c40e service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:05.496494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34b4a7-6096-4473-8b92-3eb4cb66c40e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:05.498234 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ff34b4a7-6096-4473-8b92-3eb4cb66c40e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:05.553298 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34b4a7-6096-4473-8b92-3eb4cb66c40e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:05.554744 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34b4a7-6096-4473-8b92-3eb4cb66c40e service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:05.563533 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1357/2739] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:05 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:13.353962 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69c6eb-d8f8-404b-9122-a19c26169120 service swift] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:13.363444 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69c6eb-d8f8-404b-9122-a19c26169120 service swift] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:13.367195 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf29141-7027-47b3-9c06-e2d12d25a451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:13.367819 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf29141-7027-47b3-9c06-e2d12d25a451 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:13.368096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf29141-7027-47b3-9c06-e2d12d25a451 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:13.368367 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf29141-7027-47b3-9c06-e2d12d25a451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:13.370080 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-bbf29141-7027-47b3-9c06-e2d12d25a451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:13.430899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf29141-7027-47b3-9c06-e2d12d25a451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:13.432343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf29141-7027-47b3-9c06-e2d12d25a451 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:13.442311 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1383/2740] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:16.615039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34b4a7-6096-4473-8b92-3eb4cb66c40e service cinder] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:16.616480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-ff34b4a7-6096-4473-8b92-3eb4cb66c40e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:16.631036 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34b4a7-6096-4473-8b92-3eb4cb66c40e service cinder] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:16.635638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc78fbb-d511-459a-bc34-5253af4c49a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:16.636495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc78fbb-d511-459a-bc34-5253af4c49a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:16.636777 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc78fbb-d511-459a-bc34-5253af4c49a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:16.637051 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc78fbb-d511-459a-bc34-5253af4c49a5 admin admin] PATH_INFO: `/v3/users/e10d73a08d6e43e79df2c2e1d3161b7e` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:16.638233 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc78fbb-d511-459a-bc34-5253af4c49a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10d73a08d6e43e79df2c2e1d3161b7e)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:16.640157 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc78fbb-d511-459a-bc34-5253af4c49a5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:16.685012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7cc78fbb-d511-459a-bc34-5253af4c49a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10d73a08d6e43e79df2c2e1d3161b7e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:16.692623 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7cc78fbb-d511-459a-bc34-5253af4c49a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10d73a08d6e43e79df2c2e1d3161b7e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:16.693316 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7cc78fbb-d511-459a-bc34-5253af4c49a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10d73a08d6e43e79df2c2e1d3161b7e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:16.693958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7cc78fbb-d511-459a-bc34-5253af4c49a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10d73a08d6e43e79df2c2e1d3161b7e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:16.705651 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-7cc78fbb-d511-459a-bc34-5253af4c49a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10d73a08d6e43e79df2c2e1d3161b7e'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:16.718080 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1358/2741] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:18:16 2021] DELETE /identity/v3/users/e10d73a08d6e43e79df2c2e1d3161b7e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:16.892347 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf29141-7027-47b3-9c06-e2d12d25a451 service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:16.903313 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf29141-7027-47b3-9c06-e2d12d25a451 service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:16.965578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:16.966495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:16.966782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:16.967056 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c admin admin] PATH_INFO: `/v3/projects/e237e82cdcf24c93b91e0c1799f78928` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:16.968339 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e237e82cdcf24c93b91e0c1799f78928)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:16.970296 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:17.020915 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e237e82cdcf24c93b91e0c1799f78928', 'request_id': 'req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:17.027254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e237e82cdcf24c93b91e0c1799f78928', 'request_id': 'req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:17.035215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e237e82cdcf24c93b91e0c1799f78928', 'request_id': 'req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:17.046355 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c admin admin] The token cache is being invalidate because project e237e82cdcf24c93b91e0c1799f78928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:18:17.046680 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:17.047421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0bb4c358-fdb7-4a51-a6fc-c1c31879b37c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:17.048967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1384/2742] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:18:16 2021] DELETE /identity/v3/projects/e237e82cdcf24c93b91e0c1799f78928 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:17.056752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf1436-cb67-4d47-9752-5891c2e2f026 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:17.057189 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf1436-cb67-4d47-9752-5891c2e2f026 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:17.057324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf1436-cb67-4d47-9752-5891c2e2f026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:17.076240 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-67bf1436-cb67-4d47-9752-5891c2e2f026 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:17.077458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-67bf1436-cb67-4d47-9752-5891c2e2f026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:17.135746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1359/2743] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:17.143682 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480d0f5-b134-420a-bbc0-52ef09787184 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:17.143963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480d0f5-b134-420a-bbc0-52ef09787184 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:17.144236 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480d0f5-b134-420a-bbc0-52ef09787184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:17.163258 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-6480d0f5-b134-420a-bbc0-52ef09787184 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:17.164468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6480d0f5-b134-420a-bbc0-52ef09787184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:17.172202 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1385/2744] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:17.177185 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf1436-cb67-4d47-9752-5891c2e2f026 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:17.186771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf1436-cb67-4d47-9752-5891c2e2f026 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:17.191738 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb4e0b-97fc-44f6-98d6-1a58614ba8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:17.192385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb4e0b-97fc-44f6-98d6-1a58614ba8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:17.192667 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb4e0b-97fc-44f6-98d6-1a58614ba8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:17.192943 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb4e0b-97fc-44f6-98d6-1a58614ba8f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:17.193702 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb4e0b-97fc-44f6-98d6-1a58614ba8f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:18:17.194007 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb4e0b-97fc-44f6-98d6-1a58614ba8f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:17.195636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb4e0b-97fc-44f6-98d6-1a58614ba8f6 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:17.207252 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1360/2745] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:18:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:18:17.211565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480d0f5-b134-420a-bbc0-52ef09787184 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:17.220452 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480d0f5-b134-420a-bbc0-52ef09787184 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:17.226191 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923d62f-17d5-4e48-a023-48dc409431e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:17.226852 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923d62f-17d5-4e48-a023-48dc409431e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:17.227159 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923d62f-17d5-4e48-a023-48dc409431e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:17.227432 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923d62f-17d5-4e48-a023-48dc409431e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:17.228155 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923d62f-17d5-4e48-a023-48dc409431e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:17.230044 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923d62f-17d5-4e48-a023-48dc409431e7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:17.255279 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1386/2746] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:18:17 2021] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:17.259154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb4e0b-97fc-44f6-98d6-1a58614ba8f6 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:17.269039 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb4e0b-97fc-44f6-98d6-1a58614ba8f6 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:17.331658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d53e2-99d3-4c84-b70c-8b5ce26e93b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:17.332248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d53e2-99d3-4c84-b70c-8b5ce26e93b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:17.332532 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d53e2-99d3-4c84-b70c-8b5ce26e93b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:17.333068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d53e2-99d3-4c84-b70c-8b5ce26e93b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:17.333782 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d53e2-99d3-4c84-b70c-8b5ce26e93b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:17.335746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d53e2-99d3-4c84-b70c-8b5ce26e93b9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:17.355998 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1361/2747] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:18:17 2021] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:17.360071 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923d62f-17d5-4e48-a023-48dc409431e7 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:17.370300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923d62f-17d5-4e48-a023-48dc409431e7 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:17.374990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f37d7-7b62-42d7-9987-6b13e364fe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:17.375966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f37d7-7b62-42d7-9987-6b13e364fe54 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:17.376242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f37d7-7b62-42d7-9987-6b13e364fe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:17.376509 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f37d7-7b62-42d7-9987-6b13e364fe54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:17.377270 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f37d7-7b62-42d7-9987-6b13e364fe54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:17.379040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f37d7-7b62-42d7-9987-6b13e364fe54 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:17.390760 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1387/2748] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:17.395363 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d53e2-99d3-4c84-b70c-8b5ce26e93b9 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:17.405028 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d53e2-99d3-4c84-b70c-8b5ce26e93b9 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:17.410181 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5429e-5b65-41b4-b76b-33b0e13e3c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:17.410848 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5429e-5b65-41b4-b76b-33b0e13e3c28 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:17.411128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5429e-5b65-41b4-b76b-33b0e13e3c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:17.411400 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5429e-5b65-41b4-b76b-33b0e13e3c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:17.412123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5429e-5b65-41b4-b76b-33b0e13e3c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:17.413687 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5429e-5b65-41b4-b76b-33b0e13e3c28 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:17.423154 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1362/2749] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:17 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:17.427163 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f37d7-7b62-42d7-9987-6b13e364fe54 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:17.436660 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f37d7-7b62-42d7-9987-6b13e364fe54 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:17.441595 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97698f7-782f-418f-a94c-2dca180342c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:17.442481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97698f7-782f-418f-a94c-2dca180342c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:17.442760 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97698f7-782f-418f-a94c-2dca180342c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:17.443033 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97698f7-782f-418f-a94c-2dca180342c4 admin admin] PATH_INFO: `/v3/projects/26673d4f4ae4420cb5d5468fc57cf076/users/7ed2929f309845ada24efddcfa771716/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:17.457521 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97698f7-782f-418f-a94c-2dca180342c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26673d4f4ae4420cb5d5468fc57cf076, user_id=7ed2929f309845ada24efddcfa771716, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:17.460906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97698f7-782f-418f-a94c-2dca180342c4 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:17.474144 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1388/2750] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:17 2021] PUT /identity/v3/projects/26673d4f4ae4420cb5d5468fc57cf076/users/7ed2929f309845ada24efddcfa771716/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:17.484104 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984748db-988e-4115-ad2c-b5396902744f None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:17.484392 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984748db-988e-4115-ad2c-b5396902744f None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:17.484673 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984748db-988e-4115-ad2c-b5396902744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:17.510096 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-984748db-988e-4115-ad2c-b5396902744f None None] MFA Rules not processed for user `7ed2929f309845ada24efddcfa771716`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:17.511332 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-984748db-988e-4115-ad2c-b5396902744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:17.573543 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1363/2751] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:17 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:17.586606 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97698f7-782f-418f-a94c-2dca180342c4 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:17.588454 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b97698f7-782f-418f-a94c-2dca180342c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:17.657897 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97698f7-782f-418f-a94c-2dca180342c4 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:17.664040 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796cbf9-1b3f-41c5-bd39-b9025a22e9ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:17.664670 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cbf9-1b3f-41c5-bd39-b9025a22e9ac service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:17.664949 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cbf9-1b3f-41c5-bd39-b9025a22e9ac service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:17.665222 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cbf9-1b3f-41c5-bd39-b9025a22e9ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:17.672836 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796cbf9-1b3f-41c5-bd39-b9025a22e9ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:17.674468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796cbf9-1b3f-41c5-bd39-b9025a22e9ac service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:17.683164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1389/2752] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:17 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:24.878203 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984748db-988e-4115-ad2c-b5396902744f None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:24.937359 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984748db-988e-4115-ad2c-b5396902744f None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:24.942007 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:24.942894 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:24.943178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:24.943457 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] PATH_INFO: `/v3/users/7ed2929f309845ada24efddcfa771716` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:24.944640 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed2929f309845ada24efddcfa771716)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:24.946589 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:24.990896 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed2929f309845ada24efddcfa771716'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:24.997532 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed2929f309845ada24efddcfa771716'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:24.998174 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed2929f309845ada24efddcfa771716'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:24.998840 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed2929f309845ada24efddcfa771716'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:25.010261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed2929f309845ada24efddcfa771716'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:25.023118 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1364/2753] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:18:24 2021] DELETE /identity/v3/users/7ed2929f309845ada24efddcfa771716 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:25.027554 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad0511-9c46-4736-8074-9f93cdee16e3 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:25.028068 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad0511-9c46-4736-8074-9f93cdee16e3 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:25.028176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad0511-9c46-4736-8074-9f93cdee16e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:25.045115 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-d3ad0511-9c46-4736-8074-9f93cdee16e3 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:25.046291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d3ad0511-9c46-4736-8074-9f93cdee16e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:25.103791 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1390/2754] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:25.113669 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:25.115073 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:25.170911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf2626-0abf-4e62-8705-532c69419944 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:25.174515 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce1155-f3f3-42c7-9eb5-fa4adaf7e3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:25.175142 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce1155-f3f3-42c7-9eb5-fa4adaf7e3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:25.175546 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce1155-f3f3-42c7-9eb5-fa4adaf7e3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:25.175842 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce1155-f3f3-42c7-9eb5-fa4adaf7e3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:25.184563 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce1155-f3f3-42c7-9eb5-fa4adaf7e3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:25.185968 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce1155-f3f3-42c7-9eb5-fa4adaf7e3c9 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:25.195564 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1365/2755] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:25.455748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad0511-9c46-4736-8074-9f93cdee16e3 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:25.457960 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d3ad0511-9c46-4736-8074-9f93cdee16e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:25.472556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad0511-9c46-4736-8074-9f93cdee16e3 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:25.477182 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:25.478215 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:25.478508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:25.478927 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d admin admin] PATH_INFO: `/v3/projects/26673d4f4ae4420cb5d5468fc57cf076` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:25.480014 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=26673d4f4ae4420cb5d5468fc57cf076)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:25.481936 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:25.528535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26673d4f4ae4420cb5d5468fc57cf076', 'request_id': 'req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:25.534662 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26673d4f4ae4420cb5d5468fc57cf076', 'request_id': 'req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:25.541841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26673d4f4ae4420cb5d5468fc57cf076', 'request_id': 'req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:25.552320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d admin admin] The token cache is being invalidate because project 26673d4f4ae4420cb5d5468fc57cf076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:18:25.552612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:25.553240 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-3cc7e834-ebd3-4e9f-95a0-6e13bcc75a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:25.554855 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1391/2756] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:18:25 2021] DELETE /identity/v3/projects/26673d4f4ae4420cb5d5468fc57cf076 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:25.560811 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e4092-5e84-4361-a853-3b7900b0211c None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:25.561103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e4092-5e84-4361-a853-3b7900b0211c None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:25.561408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e4092-5e84-4361-a853-3b7900b0211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:25.579290 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-c63e4092-5e84-4361-a853-3b7900b0211c None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:25.580512 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-c63e4092-5e84-4361-a853-3b7900b0211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:25.638911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1366/2757] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:25.647354 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396e7de-068a-47b8-9264-76ef3ff34e79 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:25.647642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396e7de-068a-47b8-9264-76ef3ff34e79 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:25.647917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396e7de-068a-47b8-9264-76ef3ff34e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:25.665755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-e396e7de-068a-47b8-9264-76ef3ff34e79 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:25.666977 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e396e7de-068a-47b8-9264-76ef3ff34e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:25.674642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1392/2758] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:25.679330 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e4092-5e84-4361-a853-3b7900b0211c None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:25.688872 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e4092-5e84-4361-a853-3b7900b0211c None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:25.694291 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9791b3-4584-4e15-816d-a804cbbc0fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:25.694967 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9791b3-4584-4e15-816d-a804cbbc0fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:25.695248 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9791b3-4584-4e15-816d-a804cbbc0fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:25.695522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9791b3-4584-4e15-816d-a804cbbc0fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:25.696250 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9791b3-4584-4e15-816d-a804cbbc0fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:18:25.696556 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9791b3-4584-4e15-816d-a804cbbc0fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:25.698152 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9791b3-4584-4e15-816d-a804cbbc0fb7 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:25.709532 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1367/2759] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:18:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 09 01:18:25.713764 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396e7de-068a-47b8-9264-76ef3ff34e79 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:25.723152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396e7de-068a-47b8-9264-76ef3ff34e79 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:25.728383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a09410-41e4-4571-8174-97fe727a813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:25.729050 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a09410-41e4-4571-8174-97fe727a813a admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:25.729332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a09410-41e4-4571-8174-97fe727a813a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:25.729607 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a09410-41e4-4571-8174-97fe727a813a admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:25.730308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a09410-41e4-4571-8174-97fe727a813a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:25.732198 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a09410-41e4-4571-8174-97fe727a813a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:25.757383 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1393/2760] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:18:25 2021] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:25.761419 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9791b3-4584-4e15-816d-a804cbbc0fb7 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:25.771924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9791b3-4584-4e15-816d-a804cbbc0fb7 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:25.826227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440e1e5-028f-49d5-8b1d-c3a725867f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:25.826856 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e1e5-028f-49d5-8b1d-c3a725867f48 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:25.827135 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e1e5-028f-49d5-8b1d-c3a725867f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:25.827411 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e1e5-028f-49d5-8b1d-c3a725867f48 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:25.828105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440e1e5-028f-49d5-8b1d-c3a725867f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:25.830001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440e1e5-028f-49d5-8b1d-c3a725867f48 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:25.851444 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1368/2761] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:18:25 2021] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:25.855306 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a09410-41e4-4571-8174-97fe727a813a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:25.865749 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a09410-41e4-4571-8174-97fe727a813a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:25.870212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77026345-07a1-4ed6-a5fc-501334a153c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:25.870881 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77026345-07a1-4ed6-a5fc-501334a153c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:25.871160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77026345-07a1-4ed6-a5fc-501334a153c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:25.871433 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77026345-07a1-4ed6-a5fc-501334a153c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:25.872158 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77026345-07a1-4ed6-a5fc-501334a153c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:25.873731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77026345-07a1-4ed6-a5fc-501334a153c9 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:25.884369 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1394/2762] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:25 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:25.888393 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440e1e5-028f-49d5-8b1d-c3a725867f48 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:25.898926 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440e1e5-028f-49d5-8b1d-c3a725867f48 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:25.903447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada36d0b-a90e-407d-964f-8468c579ba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:25.904082 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada36d0b-a90e-407d-964f-8468c579ba2e admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:25.904360 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada36d0b-a90e-407d-964f-8468c579ba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:25.904635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada36d0b-a90e-407d-964f-8468c579ba2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:25.905352 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada36d0b-a90e-407d-964f-8468c579ba2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:25.906957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada36d0b-a90e-407d-964f-8468c579ba2e admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:25.916923 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1369/2763] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:25.920841 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77026345-07a1-4ed6-a5fc-501334a153c9 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:25.931675 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77026345-07a1-4ed6-a5fc-501334a153c9 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:25.936233 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db566ffd-a118-4aad-a60d-1934ccf8afb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:25.937092 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db566ffd-a118-4aad-a60d-1934ccf8afb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:25.937374 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db566ffd-a118-4aad-a60d-1934ccf8afb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:25.937678 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db566ffd-a118-4aad-a60d-1934ccf8afb6 admin admin] PATH_INFO: `/v3/projects/b753e7bac01a4b308a3bf155ebd88bdd/users/383fc4771ec24f68b392fb6b428fa937/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:25.952098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db566ffd-a118-4aad-a60d-1934ccf8afb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b753e7bac01a4b308a3bf155ebd88bdd, user_id=383fc4771ec24f68b392fb6b428fa937, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:25.954783 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db566ffd-a118-4aad-a60d-1934ccf8afb6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:25.968501 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1395/2764] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:25 2021] PUT /identity/v3/projects/b753e7bac01a4b308a3bf155ebd88bdd/users/383fc4771ec24f68b392fb6b428fa937/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:25.979776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d951c5-bd7c-4ad7-bbbc-55d31f7e0e9a None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:25.980068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d951c5-bd7c-4ad7-bbbc-55d31f7e0e9a None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:25.980351 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d951c5-bd7c-4ad7-bbbc-55d31f7e0e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:26.008492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b5d951c5-bd7c-4ad7-bbbc-55d31f7e0e9a None None] MFA Rules not processed for user `383fc4771ec24f68b392fb6b428fa937`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:26.010685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b5d951c5-bd7c-4ad7-bbbc-55d31f7e0e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:26.075938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1370/2765] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:25 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:26.080572 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db566ffd-a118-4aad-a60d-1934ccf8afb6 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:26.140066 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db566ffd-a118-4aad-a60d-1934ccf8afb6 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:26.147064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893c090-8f14-45e9-8f83-f53ba1b5c024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:26.147990 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c090-8f14-45e9-8f83-f53ba1b5c024 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:26.148279 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c090-8f14-45e9-8f83-f53ba1b5c024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:26.148556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c090-8f14-45e9-8f83-f53ba1b5c024 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:26.149265 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893c090-8f14-45e9-8f83-f53ba1b5c024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:26.151212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893c090-8f14-45e9-8f83-f53ba1b5c024 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:26.175926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1396/2766] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:18:26 2021] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:26.180102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d951c5-bd7c-4ad7-bbbc-55d31f7e0e9a None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:26.190747 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d951c5-bd7c-4ad7-bbbc-55d31f7e0e9a None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:26.245213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae34755-39c9-45a9-b1a0-2bd6f678af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:26.245872 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae34755-39c9-45a9-b1a0-2bd6f678af48 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:26.246158 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae34755-39c9-45a9-b1a0-2bd6f678af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:26.246470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae34755-39c9-45a9-b1a0-2bd6f678af48 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:26.247166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae34755-39c9-45a9-b1a0-2bd6f678af48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:26.249101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae34755-39c9-45a9-b1a0-2bd6f678af48 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:26.268878 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1371/2767] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:18:26 2021] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:26.274289 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893c090-8f14-45e9-8f83-f53ba1b5c024 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:26.284417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893c090-8f14-45e9-8f83-f53ba1b5c024 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:26.289570 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e025a2-39d0-47ef-ac52-a47cf44ac905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:26.290217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e025a2-39d0-47ef-ac52-a47cf44ac905 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:26.290523 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e025a2-39d0-47ef-ac52-a47cf44ac905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:26.290801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e025a2-39d0-47ef-ac52-a47cf44ac905 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:26.291533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e025a2-39d0-47ef-ac52-a47cf44ac905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:26.293108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e025a2-39d0-47ef-ac52-a47cf44ac905 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:26.304422 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1397/2768] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:26.308424 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae34755-39c9-45a9-b1a0-2bd6f678af48 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:26.318792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae34755-39c9-45a9-b1a0-2bd6f678af48 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:26.323322 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd4cce-5cc3-4fc8-a042-a50e723c9f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:26.324187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4cce-5cc3-4fc8-a042-a50e723c9f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:26.324470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4cce-5cc3-4fc8-a042-a50e723c9f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:26.324746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4cce-5cc3-4fc8-a042-a50e723c9f17 admin admin] PATH_INFO: `/v3/projects/873a088e33c04033b44a7fc3135f6f72/users/6fc6db0425b740e0aa3c03c2cbd273ff/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:26.340122 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd4cce-5cc3-4fc8-a042-a50e723c9f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873a088e33c04033b44a7fc3135f6f72, user_id=6fc6db0425b740e0aa3c03c2cbd273ff, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:26.342714 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd4cce-5cc3-4fc8-a042-a50e723c9f17 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:26.355364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1372/2769] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:26 2021] PUT /identity/v3/projects/873a088e33c04033b44a7fc3135f6f72/users/6fc6db0425b740e0aa3c03c2cbd273ff/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:26.359332 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e025a2-39d0-47ef-ac52-a47cf44ac905 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:26.369650 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e025a2-39d0-47ef-ac52-a47cf44ac905 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:26.423259 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ab5c0-4cc0-4775-a456-701e82bd7f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:26.423919 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab5c0-4cc0-4775-a456-701e82bd7f59 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:26.424204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab5c0-4cc0-4775-a456-701e82bd7f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:26.424483 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab5c0-4cc0-4775-a456-701e82bd7f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:26.425742 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ab5c0-4cc0-4775-a456-701e82bd7f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:26.427368 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ab5c0-4cc0-4775-a456-701e82bd7f59 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:26.436935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1398/2770] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:26 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:26.441852 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd4cce-5cc3-4fc8-a042-a50e723c9f17 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:26.451858 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd4cce-5cc3-4fc8-a042-a50e723c9f17 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:26.456898 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa64890-173b-484f-83e5-1566ebcf5c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:26.458041 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa64890-173b-484f-83e5-1566ebcf5c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:26.458322 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa64890-173b-484f-83e5-1566ebcf5c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:26.458628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa64890-173b-484f-83e5-1566ebcf5c95 admin admin] PATH_INFO: `/v3/projects/873a088e33c04033b44a7fc3135f6f72/users/6fc6db0425b740e0aa3c03c2cbd273ff/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:26.460637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa64890-173b-484f-83e5-1566ebcf5c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873a088e33c04033b44a7fc3135f6f72, user_id=6fc6db0425b740e0aa3c03c2cbd273ff, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:26.463328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa64890-173b-484f-83e5-1566ebcf5c95 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:26.473429 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1373/2771] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:26 2021] PUT /identity/v3/projects/873a088e33c04033b44a7fc3135f6f72/users/6fc6db0425b740e0aa3c03c2cbd273ff/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:26.483500 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5c370-249d-41d2-8050-323d2fd00e01 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:26.483793 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5c370-249d-41d2-8050-323d2fd00e01 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:26.484073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5c370-249d-41d2-8050-323d2fd00e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:26.511052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-41c5c370-249d-41d2-8050-323d2fd00e01 None None] MFA Rules not processed for user `6fc6db0425b740e0aa3c03c2cbd273ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:26.512253 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-41c5c370-249d-41d2-8050-323d2fd00e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:26.579027 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1399/2772] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:26 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:18:26.589659 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa64890-173b-484f-83e5-1566ebcf5c95 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:26.591443 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-faa64890-173b-484f-83e5-1566ebcf5c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:26.647029 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa64890-173b-484f-83e5-1566ebcf5c95 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:26.650706 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc24128-5e75-486f-8b90-980f0cbfb756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:26.651374 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc24128-5e75-486f-8b90-980f0cbfb756 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:26.651659 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc24128-5e75-486f-8b90-980f0cbfb756 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:26.651938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc24128-5e75-486f-8b90-980f0cbfb756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:26.661921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc24128-5e75-486f-8b90-980f0cbfb756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:26.663374 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc24128-5e75-486f-8b90-980f0cbfb756 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:26.672746 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1374/2773] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:26 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:26.699413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5c370-249d-41d2-8050-323d2fd00e01 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:26.760488 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5c370-249d-41d2-8050-323d2fd00e01 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:26.764994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:26.765851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:26.766127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:26.766423 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] PATH_INFO: `/v3/users/383fc4771ec24f68b392fb6b428fa937` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:26.767634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=383fc4771ec24f68b392fb6b428fa937)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:26.769540 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:26.814868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383fc4771ec24f68b392fb6b428fa937'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:26.815567 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383fc4771ec24f68b392fb6b428fa937'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:26.822145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383fc4771ec24f68b392fb6b428fa937'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:26.822801 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383fc4771ec24f68b392fb6b428fa937'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:26.834351 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383fc4771ec24f68b392fb6b428fa937'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:26.850101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1400/2774] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:18:26 2021] DELETE /identity/v3/users/383fc4771ec24f68b392fb6b428fa937 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:26.854625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510dec-3387-441c-be32-465db06a0e98 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:26.854917 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510dec-3387-441c-be32-465db06a0e98 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:26.855200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510dec-3387-441c-be32-465db06a0e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:26.873206 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-f5510dec-3387-441c-be32-465db06a0e98 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:26.874428 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f5510dec-3387-441c-be32-465db06a0e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:26.935682 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1375/2775] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:26.945705 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:26.947217 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:27.002460 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447c263-58e1-4a47-9987-2b3039f54e79 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:27.006152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a9dd8-d611-4ea6-83a7-f0252c0369ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:27.006821 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a9dd8-d611-4ea6-83a7-f0252c0369ae service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:27.007108 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a9dd8-d611-4ea6-83a7-f0252c0369ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:27.007384 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a9dd8-d611-4ea6-83a7-f0252c0369ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:27.025593 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a9dd8-d611-4ea6-83a7-f0252c0369ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:27.028015 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a9dd8-d611-4ea6-83a7-f0252c0369ae service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:27.039115 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1401/2776] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:27.294986 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5510dec-3387-441c-be32-465db06a0e98 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:27.296394 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f5510dec-3387-441c-be32-465db06a0e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:27.308262 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5510dec-3387-441c-be32-465db06a0e98 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:27.314023 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:27.314921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:27.315197 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:27.315468 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] PATH_INFO: `/v3/projects/b753e7bac01a4b308a3bf155ebd88bdd` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:27.316871 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b753e7bac01a4b308a3bf155ebd88bdd)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:27.318808 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:27.364431 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b753e7bac01a4b308a3bf155ebd88bdd', 'request_id': 'req-13ba8d07-5650-4570-a995-efdf3e409802'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.369669 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b753e7bac01a4b308a3bf155ebd88bdd', 'request_id': 'req-13ba8d07-5650-4570-a995-efdf3e409802'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.375538 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b753e7bac01a4b308a3bf155ebd88bdd', 'request_id': 'req-13ba8d07-5650-4570-a995-efdf3e409802'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.387531 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] The token cache is being invalidate because project b753e7bac01a4b308a3bf155ebd88bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:18:27.387773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.388368 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.389912 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1376/2777] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:18:27 2021] DELETE /identity/v3/projects/b753e7bac01a4b308a3bf155ebd88bdd => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:27.394459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a9dd8-d611-4ea6-83a7-f0252c0369ae service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:27.404652 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a9dd8-d611-4ea6-83a7-f0252c0369ae service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:27.459715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab28e4-f94d-45c1-94be-980cf88e1fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:27.460567 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab28e4-f94d-45c1-94be-980cf88e1fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:27.460851 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab28e4-f94d-45c1-94be-980cf88e1fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:27.461126 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab28e4-f94d-45c1-94be-980cf88e1fc6 admin admin] PATH_INFO: `/v3/users/6fc6db0425b740e0aa3c03c2cbd273ff` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:27.462319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab28e4-f94d-45c1-94be-980cf88e1fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc6db0425b740e0aa3c03c2cbd273ff)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:27.464248 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab28e4-f94d-45c1-94be-980cf88e1fc6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:27.507792 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-7bab28e4-f94d-45c1-94be-980cf88e1fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc6db0425b740e0aa3c03c2cbd273ff'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.508427 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-7bab28e4-f94d-45c1-94be-980cf88e1fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc6db0425b740e0aa3c03c2cbd273ff'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.515049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-7bab28e4-f94d-45c1-94be-980cf88e1fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc6db0425b740e0aa3c03c2cbd273ff'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.515664 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-7bab28e4-f94d-45c1-94be-980cf88e1fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc6db0425b740e0aa3c03c2cbd273ff'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.527298 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-7bab28e4-f94d-45c1-94be-980cf88e1fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc6db0425b740e0aa3c03c2cbd273ff'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.539890 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1402/2778] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:18:27 2021] DELETE /identity/v3/users/6fc6db0425b740e0aa3c03c2cbd273ff => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:27.799636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:27.801693 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:27.815131 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba8d07-5650-4570-a995-efdf3e409802 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:27.871165 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe264838-b64c-47fe-8e04-e5e7dc8ce541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:27.872018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264838-b64c-47fe-8e04-e5e7dc8ce541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:27.872303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264838-b64c-47fe-8e04-e5e7dc8ce541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:27.872581 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264838-b64c-47fe-8e04-e5e7dc8ce541 admin admin] PATH_INFO: `/v3/projects/873a088e33c04033b44a7fc3135f6f72` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:27.873760 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe264838-b64c-47fe-8e04-e5e7dc8ce541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873a088e33c04033b44a7fc3135f6f72)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:27.875685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe264838-b64c-47fe-8e04-e5e7dc8ce541 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:27.921544 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-fe264838-b64c-47fe-8e04-e5e7dc8ce541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873a088e33c04033b44a7fc3135f6f72', 'request_id': 'req-fe264838-b64c-47fe-8e04-e5e7dc8ce541'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.927024 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-fe264838-b64c-47fe-8e04-e5e7dc8ce541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873a088e33c04033b44a7fc3135f6f72', 'request_id': 'req-fe264838-b64c-47fe-8e04-e5e7dc8ce541'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.932799 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-fe264838-b64c-47fe-8e04-e5e7dc8ce541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873a088e33c04033b44a7fc3135f6f72', 'request_id': 'req-fe264838-b64c-47fe-8e04-e5e7dc8ce541'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.945862 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-fe264838-b64c-47fe-8e04-e5e7dc8ce541 admin admin] The token cache is being invalidate because project 873a088e33c04033b44a7fc3135f6f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:18:27.946487 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-fe264838-b64c-47fe-8e04-e5e7dc8ce541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.946792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-fe264838-b64c-47fe-8e04-e5e7dc8ce541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:27.948319 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1377/2779] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:18:27 2021] DELETE /identity/v3/projects/873a088e33c04033b44a7fc3135f6f72 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:27.954181 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67368831-1c25-4389-a0ef-f9e75c1b5ef1 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:27.954501 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67368831-1c25-4389-a0ef-f9e75c1b5ef1 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:27.954784 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67368831-1c25-4389-a0ef-f9e75c1b5ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:27.974341 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-67368831-1c25-4389-a0ef-f9e75c1b5ef1 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:27.975607 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-67368831-1c25-4389-a0ef-f9e75c1b5ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:28.035949 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1403/2780] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:28.043915 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d56a8b-916d-49ce-b77b-2dfb3c604dcd None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.044310 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d56a8b-916d-49ce-b77b-2dfb3c604dcd None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.044684 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d56a8b-916d-49ce-b77b-2dfb3c604dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.064697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-57d56a8b-916d-49ce-b77b-2dfb3c604dcd None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:28.066246 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-57d56a8b-916d-49ce-b77b-2dfb3c604dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:28.075554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1378/2781] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:18:28.079871 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67368831-1c25-4389-a0ef-f9e75c1b5ef1 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:28.092722 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67368831-1c25-4389-a0ef-f9e75c1b5ef1 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:28.098794 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ce31e-1a8a-41af-8278-088580ceff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:28.099614 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ce31e-1a8a-41af-8278-088580ceff32 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.099926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ce31e-1a8a-41af-8278-088580ceff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.100177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ce31e-1a8a-41af-8278-088580ceff32 admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.100926 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ce31e-1a8a-41af-8278-088580ceff32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:18:28.101257 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ce31e-1a8a-41af-8278-088580ceff32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:28.102947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ce31e-1a8a-41af-8278-088580ceff32 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:28.118174 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1404/2782] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:18:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:18:28.119695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d56a8b-916d-49ce-b77b-2dfb3c604dcd None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:28.129084 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d56a8b-916d-49ce-b77b-2dfb3c604dcd None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:28.133773 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6249e0-4a6d-445c-a614-2a16cd32ed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:28.134442 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6249e0-4a6d-445c-a614-2a16cd32ed1a admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.134721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6249e0-4a6d-445c-a614-2a16cd32ed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.135050 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6249e0-4a6d-445c-a614-2a16cd32ed1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.135724 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6249e0-4a6d-445c-a614-2a16cd32ed1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:28.137645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6249e0-4a6d-445c-a614-2a16cd32ed1a admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:28.164120 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1379/2783] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:18:28 2021] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:28.168278 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ce31e-1a8a-41af-8278-088580ceff32 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:28.178338 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ce31e-1a8a-41af-8278-088580ceff32 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:28.235831 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a793234-2d3b-4320-848d-3ed2934c47f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:28.236603 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a793234-2d3b-4320-848d-3ed2934c47f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.236965 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a793234-2d3b-4320-848d-3ed2934c47f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.237319 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a793234-2d3b-4320-848d-3ed2934c47f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.238413 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a793234-2d3b-4320-848d-3ed2934c47f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:28.240434 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a793234-2d3b-4320-848d-3ed2934c47f1 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:28.262333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1405/2784] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:18:28 2021] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:28.266443 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6249e0-4a6d-445c-a614-2a16cd32ed1a admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:28.277306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6249e0-4a6d-445c-a614-2a16cd32ed1a admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:28.281993 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdf81a-5bf6-47ad-9a17-65f877b60dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:28.282666 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdf81a-5bf6-47ad-9a17-65f877b60dad admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.282944 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdf81a-5bf6-47ad-9a17-65f877b60dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.283215 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdf81a-5bf6-47ad-9a17-65f877b60dad admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.283937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdf81a-5bf6-47ad-9a17-65f877b60dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:28.285629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdf81a-5bf6-47ad-9a17-65f877b60dad admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:28.295547 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1380/2785] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:28.299380 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a793234-2d3b-4320-848d-3ed2934c47f1 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:28.309147 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a793234-2d3b-4320-848d-3ed2934c47f1 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:28.313714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7e303-61fa-4e78-a082-aa9a46e4f2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:28.314358 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7e303-61fa-4e78-a082-aa9a46e4f2ff admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.314674 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7e303-61fa-4e78-a082-aa9a46e4f2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.314954 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7e303-61fa-4e78-a082-aa9a46e4f2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.316227 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7e303-61fa-4e78-a082-aa9a46e4f2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:28.318098 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7e303-61fa-4e78-a082-aa9a46e4f2ff admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:28.327804 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1406/2786] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:28.332896 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdf81a-5bf6-47ad-9a17-65f877b60dad admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:28.342624 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdf81a-5bf6-47ad-9a17-65f877b60dad admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:28.347451 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4f7c-1b3d-41e2-9a9e-4dcffc26e7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:28.348361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4f7c-1b3d-41e2-9a9e-4dcffc26e7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.348635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4f7c-1b3d-41e2-9a9e-4dcffc26e7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.348902 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4f7c-1b3d-41e2-9a9e-4dcffc26e7e5 admin admin] PATH_INFO: `/v3/projects/d92743208a19443cac166cfa2138023d/users/8e93c7393a264b0da8d8bcb08d6f5b93/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.362978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f4f7c-1b3d-41e2-9a9e-4dcffc26e7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92743208a19443cac166cfa2138023d, user_id=8e93c7393a264b0da8d8bcb08d6f5b93, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:28.365685 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f4f7c-1b3d-41e2-9a9e-4dcffc26e7e5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:28.379948 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1381/2787] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:28 2021] PUT /identity/v3/projects/d92743208a19443cac166cfa2138023d/users/8e93c7393a264b0da8d8bcb08d6f5b93/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:28.392045 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d62f7-d0ab-4e7a-a8ad-e2998e87a359 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.392345 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d62f7-d0ab-4e7a-a8ad-e2998e87a359 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.392607 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d62f7-d0ab-4e7a-a8ad-e2998e87a359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.419453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-260d62f7-d0ab-4e7a-a8ad-e2998e87a359 None None] MFA Rules not processed for user `8e93c7393a264b0da8d8bcb08d6f5b93`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:28.420654 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-260d62f7-d0ab-4e7a-a8ad-e2998e87a359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:28.483189 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1407/2788] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:28 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:18:28.487482 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4f7c-1b3d-41e2-9a9e-4dcffc26e7e5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:28.547641 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4f7c-1b3d-41e2-9a9e-4dcffc26e7e5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:28.553261 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06784f-d29e-4c87-9c08-8872038c4ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:28.553905 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06784f-d29e-4c87-9c08-8872038c4ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.554187 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06784f-d29e-4c87-9c08-8872038c4ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.554508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06784f-d29e-4c87-9c08-8872038c4ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.555221 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06784f-d29e-4c87-9c08-8872038c4ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:28.557128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06784f-d29e-4c87-9c08-8872038c4ab0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:28.582788 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1382/2789] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:18:28 2021] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:28.587224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d62f7-d0ab-4e7a-a8ad-e2998e87a359 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:28.598146 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d62f7-d0ab-4e7a-a8ad-e2998e87a359 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:28.651653 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b312aef-1953-459f-9aa6-96cf40f3ab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:28.652308 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b312aef-1953-459f-9aa6-96cf40f3ab98 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.652586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b312aef-1953-459f-9aa6-96cf40f3ab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.652859 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b312aef-1953-459f-9aa6-96cf40f3ab98 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.653560 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b312aef-1953-459f-9aa6-96cf40f3ab98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:28.655495 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b312aef-1953-459f-9aa6-96cf40f3ab98 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:28.674146 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1408/2790] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:18:28 2021] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:28.678703 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06784f-d29e-4c87-9c08-8872038c4ab0 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:28.688899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06784f-d29e-4c87-9c08-8872038c4ab0 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:28.694638 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fede9-b8af-461b-8396-1b550601f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:28.695282 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fede9-b8af-461b-8396-1b550601f3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.695562 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fede9-b8af-461b-8396-1b550601f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.695836 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fede9-b8af-461b-8396-1b550601f3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.696569 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fede9-b8af-461b-8396-1b550601f3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:28.698139 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fede9-b8af-461b-8396-1b550601f3c5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:28.709103 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1383/2791] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:28.712961 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b312aef-1953-459f-9aa6-96cf40f3ab98 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:28.722781 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b312aef-1953-459f-9aa6-96cf40f3ab98 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:28.727562 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87650bf7-9948-4a03-935c-fa84131f3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:28.728245 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87650bf7-9948-4a03-935c-fa84131f3243 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.728531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87650bf7-9948-4a03-935c-fa84131f3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.728811 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87650bf7-9948-4a03-935c-fa84131f3243 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.729573 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87650bf7-9948-4a03-935c-fa84131f3243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:28.731224 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87650bf7-9948-4a03-935c-fa84131f3243 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:28.741771 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1409/2792] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:18:28.745609 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fede9-b8af-461b-8396-1b550601f3c5 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:28.756165 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fede9-b8af-461b-8396-1b550601f3c5 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:28.760872 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc2db2-6369-4c92-824d-806df538a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:28.761731 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc2db2-6369-4c92-824d-806df538a627 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.762013 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc2db2-6369-4c92-824d-806df538a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.762288 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc2db2-6369-4c92-824d-806df538a627 admin admin] PATH_INFO: `/v3/projects/96ce6c1aec8b4f0fa5383c932d996fbf/users/65d1d4449af9470191da30e76e3d2481/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.780629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc2db2-6369-4c92-824d-806df538a627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ce6c1aec8b4f0fa5383c932d996fbf, user_id=65d1d4449af9470191da30e76e3d2481, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:28.783289 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc2db2-6369-4c92-824d-806df538a627 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:28.796012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1384/2793] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:28 2021] PUT /identity/v3/projects/96ce6c1aec8b4f0fa5383c932d996fbf/users/65d1d4449af9470191da30e76e3d2481/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:28.807011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463cd1-c26f-4a13-b96f-79178245775b None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.807321 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463cd1-c26f-4a13-b96f-79178245775b None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.807615 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463cd1-c26f-4a13-b96f-79178245775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.835241 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-89463cd1-c26f-4a13-b96f-79178245775b None None] MFA Rules not processed for user `65d1d4449af9470191da30e76e3d2481`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:28.836490 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-89463cd1-c26f-4a13-b96f-79178245775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:28.898995 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1410/2794] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:28 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:28.903486 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc2db2-6369-4c92-824d-806df538a627 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:28.962266 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc2db2-6369-4c92-824d-806df538a627 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:28.966879 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160d039-835e-40ab-8909-8b8351f6f845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:28.967513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160d039-835e-40ab-8909-8b8351f6f845 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:28.967793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160d039-835e-40ab-8909-8b8351f6f845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:28.968065 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160d039-835e-40ab-8909-8b8351f6f845 admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:28.968751 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160d039-835e-40ab-8909-8b8351f6f845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:28.970900 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160d039-835e-40ab-8909-8b8351f6f845 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:28.995407 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1385/2795] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:18:28 2021] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:28.999309 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463cd1-c26f-4a13-b96f-79178245775b None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:29.009661 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463cd1-c26f-4a13-b96f-79178245775b None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:29.062948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1935c6-2f2e-4683-a7d8-7ba2f524b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:29.063610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1935c6-2f2e-4683-a7d8-7ba2f524b39e admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:29.063891 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1935c6-2f2e-4683-a7d8-7ba2f524b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:29.064167 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1935c6-2f2e-4683-a7d8-7ba2f524b39e admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:29.064868 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1935c6-2f2e-4683-a7d8-7ba2f524b39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:29.066910 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1935c6-2f2e-4683-a7d8-7ba2f524b39e admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:29.086533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1411/2796] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:18:28 2021] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:29.090475 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160d039-835e-40ab-8909-8b8351f6f845 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:29.101323 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160d039-835e-40ab-8909-8b8351f6f845 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:29.106065 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5034cc-3197-48f4-a67b-56cbaf56addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:29.106775 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5034cc-3197-48f4-a67b-56cbaf56addb admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:29.107061 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5034cc-3197-48f4-a67b-56cbaf56addb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:29.107338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5034cc-3197-48f4-a67b-56cbaf56addb admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:29.108068 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5034cc-3197-48f4-a67b-56cbaf56addb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:29.109653 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5034cc-3197-48f4-a67b-56cbaf56addb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:29.120715 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1386/2797] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:29.124665 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1935c6-2f2e-4683-a7d8-7ba2f524b39e admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:29.134511 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1935c6-2f2e-4683-a7d8-7ba2f524b39e admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:29.139139 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2745-e3d4-4077-9651-2649cadf247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:29.140004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2745-e3d4-4077-9651-2649cadf247b admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:29.140283 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2745-e3d4-4077-9651-2649cadf247b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:29.140556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2745-e3d4-4077-9651-2649cadf247b admin admin] PATH_INFO: `/v3/projects/8439fb20e80b47ad93d562fd13b87c5d/users/36f5a75ead3e4cb4bc897faabb0138f4/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:29.154701 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c2745-e3d4-4077-9651-2649cadf247b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8439fb20e80b47ad93d562fd13b87c5d, user_id=36f5a75ead3e4cb4bc897faabb0138f4, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:29.157336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c2745-e3d4-4077-9651-2649cadf247b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:29.170633 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1412/2798] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:29 2021] PUT /identity/v3/projects/8439fb20e80b47ad93d562fd13b87c5d/users/36f5a75ead3e4cb4bc897faabb0138f4/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:18:29.174492 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5034cc-3197-48f4-a67b-56cbaf56addb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:29.185078 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5034cc-3197-48f4-a67b-56cbaf56addb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:29.239716 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30666f-c480-46f0-9968-dee4046b4bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:29.240361 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30666f-c480-46f0-9968-dee4046b4bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:29.240639 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30666f-c480-46f0-9968-dee4046b4bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:29.240909 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30666f-c480-46f0-9968-dee4046b4bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:29.241625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30666f-c480-46f0-9968-dee4046b4bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:29.243223 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30666f-c480-46f0-9968-dee4046b4bd5 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:29.252576 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1387/2799] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:29 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:29.256891 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2745-e3d4-4077-9651-2649cadf247b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:29.266854 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2745-e3d4-4077-9651-2649cadf247b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:29.272127 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708e033-6c19-426a-a5d8-1d5cd97d75ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:29.272992 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708e033-6c19-426a-a5d8-1d5cd97d75ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:29.273274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708e033-6c19-426a-a5d8-1d5cd97d75ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:29.273550 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708e033-6c19-426a-a5d8-1d5cd97d75ec admin admin] PATH_INFO: `/v3/projects/8439fb20e80b47ad93d562fd13b87c5d/users/36f5a75ead3e4cb4bc897faabb0138f4/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:29.275531 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708e033-6c19-426a-a5d8-1d5cd97d75ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8439fb20e80b47ad93d562fd13b87c5d, user_id=36f5a75ead3e4cb4bc897faabb0138f4, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:29.278175 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708e033-6c19-426a-a5d8-1d5cd97d75ec admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:29.288680 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1413/2800] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:29 2021] PUT /identity/v3/projects/8439fb20e80b47ad93d562fd13b87c5d/users/36f5a75ead3e4cb4bc897faabb0138f4/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:29.298659 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187ac08-6ee5-4f9c-b314-eae485f7111b None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:29.299079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187ac08-6ee5-4f9c-b314-eae485f7111b None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:29.299362 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187ac08-6ee5-4f9c-b314-eae485f7111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:29.325118 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-9187ac08-6ee5-4f9c-b314-eae485f7111b None None] MFA Rules not processed for user `36f5a75ead3e4cb4bc897faabb0138f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:29.326349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9187ac08-6ee5-4f9c-b314-eae485f7111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:29.397408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1388/2801] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:29 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:29.407680 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708e033-6c19-426a-a5d8-1d5cd97d75ec admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:29.409407 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e708e033-6c19-426a-a5d8-1d5cd97d75ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:29.464838 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708e033-6c19-426a-a5d8-1d5cd97d75ec admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:29.468532 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e833a-59eb-4ffa-b4a2-b08a53c42e15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:29.469164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e833a-59eb-4ffa-b4a2-b08a53c42e15 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:29.469452 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e833a-59eb-4ffa-b4a2-b08a53c42e15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:29.469729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e833a-59eb-4ffa-b4a2-b08a53c42e15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:29.479395 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e833a-59eb-4ffa-b4a2-b08a53c42e15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:29.480828 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e833a-59eb-4ffa-b4a2-b08a53c42e15 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:29.490198 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1414/2802] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:29 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:29.529358 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187ac08-6ee5-4f9c-b314-eae485f7111b None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:29.531010 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9187ac08-6ee5-4f9c-b314-eae485f7111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:29.543386 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187ac08-6ee5-4f9c-b314-eae485f7111b None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:29.546924 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4ce80-ad6a-4a09-af99-a08421ac2276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:29.547549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4ce80-ad6a-4a09-af99-a08421ac2276 service cinder] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:29.547831 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4ce80-ad6a-4a09-af99-a08421ac2276 service cinder] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:29.548108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4ce80-ad6a-4a09-af99-a08421ac2276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:29.603798 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4ce80-ad6a-4a09-af99-a08421ac2276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:29.605210 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4ce80-ad6a-4a09-af99-a08421ac2276 service cinder] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:29.613820 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1389/2803] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:29 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:32.464379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e833a-59eb-4ffa-b4a2-b08a53c42e15 service cinder] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:32.525580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e833a-59eb-4ffa-b4a2-b08a53c42e15 service cinder] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:32.530351 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:32.531238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:32.531522 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:32.531798 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] PATH_INFO: `/v3/users/8e93c7393a264b0da8d8bcb08d6f5b93` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:32.533287 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e93c7393a264b0da8d8bcb08d6f5b93)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:32.535499 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:32.579315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e93c7393a264b0da8d8bcb08d6f5b93'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:32.579959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e93c7393a264b0da8d8bcb08d6f5b93'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:32.587143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e93c7393a264b0da8d8bcb08d6f5b93'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:32.587768 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e93c7393a264b0da8d8bcb08d6f5b93'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:32.599012 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e93c7393a264b0da8d8bcb08d6f5b93'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:32.610683 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1415/2804] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:18:32 2021] DELETE /identity/v3/users/8e93c7393a264b0da8d8bcb08d6f5b93 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:32.615752 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b63ca-a484-47d5-9355-dffd46ed95e9 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:32.616226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b63ca-a484-47d5-9355-dffd46ed95e9 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:32.616358 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b63ca-a484-47d5-9355-dffd46ed95e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:32.633439 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-a46b63ca-a484-47d5-9355-dffd46ed95e9 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:32.634726 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a46b63ca-a484-47d5-9355-dffd46ed95e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:32.697529 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1390/2805] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:32.708094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:32.709553 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:32.764564 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c13c4-5243-4af0-a0a1-148d7576aad8 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:32.768242 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195846d-6013-4e25-af20-7a6e7f249efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:32.768876 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195846d-6013-4e25-af20-7a6e7f249efe service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:32.769198 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195846d-6013-4e25-af20-7a6e7f249efe service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:32.769534 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195846d-6013-4e25-af20-7a6e7f249efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:32.778379 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195846d-6013-4e25-af20-7a6e7f249efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:32.779800 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195846d-6013-4e25-af20-7a6e7f249efe service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:32.789878 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1416/2806] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:18:33.049242 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b63ca-a484-47d5-9355-dffd46ed95e9 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:33.050990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a46b63ca-a484-47d5-9355-dffd46ed95e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:33.064556 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b63ca-a484-47d5-9355-dffd46ed95e9 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:33.069903 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:33.070957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:33.071244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:33.071494 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] PATH_INFO: `/v3/projects/d92743208a19443cac166cfa2138023d` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:33.072676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92743208a19443cac166cfa2138023d)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:33.074620 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:33.120119 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92743208a19443cac166cfa2138023d', 'request_id': 'req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.125646 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92743208a19443cac166cfa2138023d', 'request_id': 'req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.131870 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92743208a19443cac166cfa2138023d', 'request_id': 'req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.143306 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] The token cache is being invalidate because project d92743208a19443cac166cfa2138023d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:18:33.143594 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.144769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.146471 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1391/2807] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:18:33 2021] DELETE /identity/v3/projects/d92743208a19443cac166cfa2138023d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:33.150438 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195846d-6013-4e25-af20-7a6e7f249efe service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:33.160480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195846d-6013-4e25-af20-7a6e7f249efe service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:33.213480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:33.214274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:33.214586 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:33.214865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] PATH_INFO: `/v3/users/65d1d4449af9470191da30e76e3d2481` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:33.216116 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d1d4449af9470191da30e76e3d2481)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:33.218096 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:33.261763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d1d4449af9470191da30e76e3d2481'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.262459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d1d4449af9470191da30e76e3d2481'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.269036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d1d4449af9470191da30e76e3d2481'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.270330 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d1d4449af9470191da30e76e3d2481'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.281431 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d1d4449af9470191da30e76e3d2481'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.293618 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1417/2808] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:18:33 2021] DELETE /identity/v3/users/65d1d4449af9470191da30e76e3d2481 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:33.547200 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:33.548635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:33.564671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828a9eb-a0cc-4e33-bcdc-1eb4f69cb8b3 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:33.621267 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:33.622101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:33.622412 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:33.622695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] PATH_INFO: `/v3/projects/96ce6c1aec8b4f0fa5383c932d996fbf` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:33.623977 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ce6c1aec8b4f0fa5383c932d996fbf)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:33.625913 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:33.669925 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ce6c1aec8b4f0fa5383c932d996fbf', 'request_id': 'req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.675245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ce6c1aec8b4f0fa5383c932d996fbf', 'request_id': 'req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.682214 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ce6c1aec8b4f0fa5383c932d996fbf', 'request_id': 'req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.698472 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] The token cache is being invalidate because project 96ce6c1aec8b4f0fa5383c932d996fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:18:33.698826 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.699474 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.701014 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1392/2809] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:18:33 2021] DELETE /identity/v3/projects/96ce6c1aec8b4f0fa5383c932d996fbf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:33.704949 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:33.706489 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:33.720038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358885-7f0d-4d7f-b60c-039837a9bf96 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:33.774130 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6157d52-8a7b-4346-b6ce-25c790d3c210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:33.775022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6157d52-8a7b-4346-b6ce-25c790d3c210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:33.775300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6157d52-8a7b-4346-b6ce-25c790d3c210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:33.775569 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6157d52-8a7b-4346-b6ce-25c790d3c210 admin admin] PATH_INFO: `/v3/users/36f5a75ead3e4cb4bc897faabb0138f4` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:33.776730 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6157d52-8a7b-4346-b6ce-25c790d3c210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f5a75ead3e4cb4bc897faabb0138f4)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:33.778657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6157d52-8a7b-4346-b6ce-25c790d3c210 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:33.821300 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a6157d52-8a7b-4346-b6ce-25c790d3c210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f5a75ead3e4cb4bc897faabb0138f4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.821937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a6157d52-8a7b-4346-b6ce-25c790d3c210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f5a75ead3e4cb4bc897faabb0138f4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.828621 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a6157d52-8a7b-4346-b6ce-25c790d3c210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f5a75ead3e4cb4bc897faabb0138f4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.829277 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a6157d52-8a7b-4346-b6ce-25c790d3c210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f5a75ead3e4cb4bc897faabb0138f4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.841354 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-a6157d52-8a7b-4346-b6ce-25c790d3c210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f5a75ead3e4cb4bc897faabb0138f4'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:33.854263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1418/2810] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:18:33 2021] DELETE /identity/v3/users/36f5a75ead3e4cb4bc897faabb0138f4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:34.123245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:34.124671 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:34.137980 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fb3ea-738f-4f2b-93f7-8ddf43f78cef admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:34.192337 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63dea4-ed87-4a92-87ed-9263df0bed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:34.193183 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63dea4-ed87-4a92-87ed-9263df0bed6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.193462 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63dea4-ed87-4a92-87ed-9263df0bed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.193735 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63dea4-ed87-4a92-87ed-9263df0bed6f admin admin] PATH_INFO: `/v3/projects/8439fb20e80b47ad93d562fd13b87c5d` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.194944 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63dea4-ed87-4a92-87ed-9263df0bed6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8439fb20e80b47ad93d562fd13b87c5d)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:34.196854 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63dea4-ed87-4a92-87ed-9263df0bed6f admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:34.242927 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1f63dea4-ed87-4a92-87ed-9263df0bed6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8439fb20e80b47ad93d562fd13b87c5d', 'request_id': 'req-1f63dea4-ed87-4a92-87ed-9263df0bed6f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:34.248159 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1f63dea4-ed87-4a92-87ed-9263df0bed6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8439fb20e80b47ad93d562fd13b87c5d', 'request_id': 'req-1f63dea4-ed87-4a92-87ed-9263df0bed6f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:34.254234 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1f63dea4-ed87-4a92-87ed-9263df0bed6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8439fb20e80b47ad93d562fd13b87c5d', 'request_id': 'req-1f63dea4-ed87-4a92-87ed-9263df0bed6f'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:34.266833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1f63dea4-ed87-4a92-87ed-9263df0bed6f admin admin] The token cache is being invalidate because project 8439fb20e80b47ad93d562fd13b87c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:18:34.267123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1f63dea4-ed87-4a92-87ed-9263df0bed6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:34.267743 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-1f63dea4-ed87-4a92-87ed-9263df0bed6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:34.269723 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1393/2811] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:18:34 2021] DELETE /identity/v3/projects/8439fb20e80b47ad93d562fd13b87c5d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:34.276173 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6256b3-740c-478d-ab7e-eee502503601 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.276468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6256b3-740c-478d-ab7e-eee502503601 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.276750 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6256b3-740c-478d-ab7e-eee502503601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.296562 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-9c6256b3-740c-478d-ab7e-eee502503601 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:34.297772 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9c6256b3-740c-478d-ab7e-eee502503601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:34.353906 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1419/2812] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:34.362167 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759af46-4acb-4fd9-989c-86473eeab402 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.362489 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759af46-4acb-4fd9-989c-86473eeab402 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.362767 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759af46-4acb-4fd9-989c-86473eeab402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.381694 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-5759af46-4acb-4fd9-989c-86473eeab402 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:34.382920 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5759af46-4acb-4fd9-989c-86473eeab402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:34.390758 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1394/2813] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:34.394957 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6256b3-740c-478d-ab7e-eee502503601 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:34.404481 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6256b3-740c-478d-ab7e-eee502503601 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:34.409022 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e5034-e01a-476e-801d-064b416bb5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:34.409665 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e5034-e01a-476e-801d-064b416bb5ea admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.410502 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e5034-e01a-476e-801d-064b416bb5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.410844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e5034-e01a-476e-801d-064b416bb5ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.411695 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e5034-e01a-476e-801d-064b416bb5ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:18:34.412006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e5034-e01a-476e-801d-064b416bb5ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:34.413611 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e5034-e01a-476e-801d-064b416bb5ea admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:34.424944 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1420/2814] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:18:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:18:34.429890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759af46-4acb-4fd9-989c-86473eeab402 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:34.439031 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759af46-4acb-4fd9-989c-86473eeab402 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:34.444155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc0203-1a73-4fbd-8c7b-75f8dc4e633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:34.444792 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc0203-1a73-4fbd-8c7b-75f8dc4e633d admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.445069 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc0203-1a73-4fbd-8c7b-75f8dc4e633d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.445340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc0203-1a73-4fbd-8c7b-75f8dc4e633d admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.446071 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc0203-1a73-4fbd-8c7b-75f8dc4e633d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:34.447986 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc0203-1a73-4fbd-8c7b-75f8dc4e633d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:34.472907 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1395/2815] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:18:34 2021] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:34.477016 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e5034-e01a-476e-801d-064b416bb5ea admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:34.486669 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e5034-e01a-476e-801d-064b416bb5ea admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:34.541113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f682fdb-afc7-4110-bed0-323ba994f599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:34.541776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f682fdb-afc7-4110-bed0-323ba994f599 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.542063 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f682fdb-afc7-4110-bed0-323ba994f599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.542349 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f682fdb-afc7-4110-bed0-323ba994f599 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.543079 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f682fdb-afc7-4110-bed0-323ba994f599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:34.544983 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f682fdb-afc7-4110-bed0-323ba994f599 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:34.564580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1421/2816] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:18:34 2021] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:34.568689 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc0203-1a73-4fbd-8c7b-75f8dc4e633d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:34.578641 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc0203-1a73-4fbd-8c7b-75f8dc4e633d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:34.584018 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab8525-7098-4815-be42-280c1ca49847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:34.584656 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab8525-7098-4815-be42-280c1ca49847 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.584938 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab8525-7098-4815-be42-280c1ca49847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.585213 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab8525-7098-4815-be42-280c1ca49847 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.585971 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab8525-7098-4815-be42-280c1ca49847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:34.587588 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab8525-7098-4815-be42-280c1ca49847 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:34.598619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1396/2817] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:34.602417 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f682fdb-afc7-4110-bed0-323ba994f599 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:34.612333 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f682fdb-afc7-4110-bed0-323ba994f599 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:34.617275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd19c00-6e52-4c36-ab2b-1e7ac05d3cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:34.617922 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd19c00-6e52-4c36-ab2b-1e7ac05d3cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.618206 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd19c00-6e52-4c36-ab2b-1e7ac05d3cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.618518 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd19c00-6e52-4c36-ab2b-1e7ac05d3cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.619251 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd19c00-6e52-4c36-ab2b-1e7ac05d3cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:34.620832 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd19c00-6e52-4c36-ab2b-1e7ac05d3cf6 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:34.630953 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1422/2818] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:34 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:34.635067 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab8525-7098-4815-be42-280c1ca49847 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:34.646324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab8525-7098-4815-be42-280c1ca49847 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:34.650962 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11606c-4dac-42aa-b98a-a0d8d4235226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:34.651819 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11606c-4dac-42aa-b98a-a0d8d4235226 admin admin] REQUEST_METHOD: `PUT` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.652105 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11606c-4dac-42aa-b98a-a0d8d4235226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.652378 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11606c-4dac-42aa-b98a-a0d8d4235226 admin admin] PATH_INFO: `/v3/projects/32584e7217c34b82a73aca6a463ea9e1/users/060d432512f6402ca669b8fee8bca382/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.666908 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11606c-4dac-42aa-b98a-a0d8d4235226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32584e7217c34b82a73aca6a463ea9e1, user_id=060d432512f6402ca669b8fee8bca382, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:34.669637 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11606c-4dac-42aa-b98a-a0d8d4235226 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:34.682358 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1397/2819] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:34 2021] PUT /identity/v3/projects/32584e7217c34b82a73aca6a463ea9e1/users/060d432512f6402ca669b8fee8bca382/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:34.693498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7cc15-11d6-4ae3-920f-a9d3db8dcae2 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.693882 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7cc15-11d6-4ae3-920f-a9d3db8dcae2 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.694170 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7cc15-11d6-4ae3-920f-a9d3db8dcae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.720637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-07f7cc15-11d6-4ae3-920f-a9d3db8dcae2 None None] MFA Rules not processed for user `060d432512f6402ca669b8fee8bca382`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:34.721830 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-07f7cc15-11d6-4ae3-920f-a9d3db8dcae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:34.783004 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1423/2820] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:34 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:18:34.788256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11606c-4dac-42aa-b98a-a0d8d4235226 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:34.846148 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11606c-4dac-42aa-b98a-a0d8d4235226 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:34.851797 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b081cc-c70a-41ec-9a54-cc169fdf46cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:34.852128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b081cc-c70a-41ec-9a54-cc169fdf46cc admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.852399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b081cc-c70a-41ec-9a54-cc169fdf46cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.852676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b081cc-c70a-41ec-9a54-cc169fdf46cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.853382 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b081cc-c70a-41ec-9a54-cc169fdf46cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:34.855313 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b081cc-c70a-41ec-9a54-cc169fdf46cc admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:34.879848 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1398/2821] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:18:34 2021] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:34.883874 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7cc15-11d6-4ae3-920f-a9d3db8dcae2 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:34.895638 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7cc15-11d6-4ae3-920f-a9d3db8dcae2 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:34.949089 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1031614-f39d-472e-b3f4-cca21b58c106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:34.949763 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1031614-f39d-472e-b3f4-cca21b58c106 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.950046 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1031614-f39d-472e-b3f4-cca21b58c106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.950318 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1031614-f39d-472e-b3f4-cca21b58c106 admin admin] PATH_INFO: `/v3/users` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.951047 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1031614-f39d-472e-b3f4-cca21b58c106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:34.952934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1031614-f39d-472e-b3f4-cca21b58c106 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:34.972866 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1424/2822] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:18:34 2021] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 09 01:18:34.976793 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b081cc-c70a-41ec-9a54-cc169fdf46cc admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:34.986830 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b081cc-c70a-41ec-9a54-cc169fdf46cc admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:34.992315 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803bfde-97f1-4eb5-838f-391b25c0b73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:34.992960 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803bfde-97f1-4eb5-838f-391b25c0b73b admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:34.993244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803bfde-97f1-4eb5-838f-391b25c0b73b admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:34.993519 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803bfde-97f1-4eb5-838f-391b25c0b73b admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:34.994243 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803bfde-97f1-4eb5-838f-391b25c0b73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:34.995869 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803bfde-97f1-4eb5-838f-391b25c0b73b admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:35.007047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1399/2823] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:18:35.011140 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1031614-f39d-472e-b3f4-cca21b58c106 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:35.021546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1031614-f39d-472e-b3f4-cca21b58c106 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:35.026126 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549610cc-7c44-45a5-a2c3-b85b12223c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:35.027027 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549610cc-7c44-45a5-a2c3-b85b12223c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:35.027304 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549610cc-7c44-45a5-a2c3-b85b12223c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:35.027576 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549610cc-7c44-45a5-a2c3-b85b12223c6b admin admin] PATH_INFO: `/v3/projects/231e64ef69284efd9f503c85b244ac20/users/df353dc3030840369a041228f005120c/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:35.041642 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549610cc-7c44-45a5-a2c3-b85b12223c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=231e64ef69284efd9f503c85b244ac20, user_id=df353dc3030840369a041228f005120c, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:35.044282 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549610cc-7c44-45a5-a2c3-b85b12223c6b admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:35.056564 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1425/2824] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:35 2021] PUT /identity/v3/projects/231e64ef69284efd9f503c85b244ac20/users/df353dc3030840369a041228f005120c/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:18:35.060409 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803bfde-97f1-4eb5-838f-391b25c0b73b admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:35.071228 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803bfde-97f1-4eb5-838f-391b25c0b73b admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:35.126635 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f8e1d-1220-44a2-9ff0-1330151ff3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:35.127296 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f8e1d-1220-44a2-9ff0-1330151ff3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:35.127578 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f8e1d-1220-44a2-9ff0-1330151ff3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:35.127855 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f8e1d-1220-44a2-9ff0-1330151ff3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:35.129275 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f8e1d-1220-44a2-9ff0-1330151ff3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:35.130958 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f8e1d-1220-44a2-9ff0-1330151ff3d8 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:35.140301 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1400/2825] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:35 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:35.144982 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549610cc-7c44-45a5-a2c3-b85b12223c6b admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:35.154967 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549610cc-7c44-45a5-a2c3-b85b12223c6b admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:35.159535 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d71f7-0950-4041-8bf5-5484f4f363ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:35.160430 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d71f7-0950-4041-8bf5-5484f4f363ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:35.160709 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d71f7-0950-4041-8bf5-5484f4f363ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:35.160982 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d71f7-0950-4041-8bf5-5484f4f363ac admin admin] PATH_INFO: `/v3/projects/231e64ef69284efd9f503c85b244ac20/users/df353dc3030840369a041228f005120c/roles/c041790a5f864dedae0b9f17b26e28ed` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:35.162968 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d71f7-0950-4041-8bf5-5484f4f363ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=231e64ef69284efd9f503c85b244ac20, user_id=df353dc3030840369a041228f005120c, role_id=c041790a5f864dedae0b9f17b26e28ed)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:35.165574 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d71f7-0950-4041-8bf5-5484f4f363ac admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:35.175566 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1426/2826] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:35 2021] PUT /identity/v3/projects/231e64ef69284efd9f503c85b244ac20/users/df353dc3030840369a041228f005120c/roles/c041790a5f864dedae0b9f17b26e28ed => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:35.186324 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4083a-c314-49a5-a25c-02666735abe1 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:35.186657 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4083a-c314-49a5-a25c-02666735abe1 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:35.186937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4083a-c314-49a5-a25c-02666735abe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:35.213549 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-32d4083a-c314-49a5-a25c-02666735abe1 None None] MFA Rules not processed for user `df353dc3030840369a041228f005120c`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:35.214791 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-32d4083a-c314-49a5-a25c-02666735abe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:35.277876 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1401/2827] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:35 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:35.287691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d71f7-0950-4041-8bf5-5484f4f363ac admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:35.289439 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-671d71f7-0950-4041-8bf5-5484f4f363ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:35.345036 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d71f7-0950-4041-8bf5-5484f4f363ac admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:35.348676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641483cf-95a0-4db2-a942-27014187f231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:35.349305 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641483cf-95a0-4db2-a942-27014187f231 service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:35.349588 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641483cf-95a0-4db2-a942-27014187f231 service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:35.349865 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641483cf-95a0-4db2-a942-27014187f231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:35.358693 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641483cf-95a0-4db2-a942-27014187f231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:35.360116 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641483cf-95a0-4db2-a942-27014187f231 service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:35.369847 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1427/2828] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:35 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:35.855983 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4083a-c314-49a5-a25c-02666735abe1 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:35.917603 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4083a-c314-49a5-a25c-02666735abe1 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:35.921999 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:35.922883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:35.923158 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:35.923426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] PATH_INFO: `/v3/users/060d432512f6402ca669b8fee8bca382` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:35.924605 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=060d432512f6402ca669b8fee8bca382)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:35.927134 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:35.969734 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060d432512f6402ca669b8fee8bca382'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:35.977346 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060d432512f6402ca669b8fee8bca382'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:35.978001 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060d432512f6402ca669b8fee8bca382'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:35.978636 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060d432512f6402ca669b8fee8bca382'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:35.990833 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060d432512f6402ca669b8fee8bca382'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:36.003079 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1402/2829] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:18:35 2021] DELETE /identity/v3/users/060d432512f6402ca669b8fee8bca382 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:36.008911 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c2efe-f86f-4d6f-bdc5-ac3bf9b0a1d4 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:36.009391 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c2efe-f86f-4d6f-bdc5-ac3bf9b0a1d4 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:36.009510 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c2efe-f86f-4d6f-bdc5-ac3bf9b0a1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:36.027011 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-2e8c2efe-f86f-4d6f-bdc5-ac3bf9b0a1d4 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:36.028213 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2e8c2efe-f86f-4d6f-bdc5-ac3bf9b0a1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:36.096264 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1428/2830] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:36.106574 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:36.108030 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:36.163532 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13231bed-f900-4bb5-b58f-0f4554835205 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:36.167244 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bfa0b-adb2-49b2-8b1b-a63e72fd18ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:36.167932 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bfa0b-adb2-49b2-8b1b-a63e72fd18ad service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:36.168166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bfa0b-adb2-49b2-8b1b-a63e72fd18ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:36.168445 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bfa0b-adb2-49b2-8b1b-a63e72fd18ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:36.178513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bfa0b-adb2-49b2-8b1b-a63e72fd18ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:36.179934 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bfa0b-adb2-49b2-8b1b-a63e72fd18ad service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:36.189255 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1403/2831] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:36.452113 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c2efe-f86f-4d6f-bdc5-ac3bf9b0a1d4 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:36.453629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-2e8c2efe-f86f-4d6f-bdc5-ac3bf9b0a1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:36.466725 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c2efe-f86f-4d6f-bdc5-ac3bf9b0a1d4 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:36.471639 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:36.473734 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:36.474023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:36.474297 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] PATH_INFO: `/v3/projects/32584e7217c34b82a73aca6a463ea9e1` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:36.475533 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32584e7217c34b82a73aca6a463ea9e1)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:36.477434 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:36.523569 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32584e7217c34b82a73aca6a463ea9e1', 'request_id': 'req-b41cfaef-6028-4277-babc-d49cf4476136'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:36.529468 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32584e7217c34b82a73aca6a463ea9e1', 'request_id': 'req-b41cfaef-6028-4277-babc-d49cf4476136'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:36.538076 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32584e7217c34b82a73aca6a463ea9e1', 'request_id': 'req-b41cfaef-6028-4277-babc-d49cf4476136'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:36.548173 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] The token cache is being invalidate because project 32584e7217c34b82a73aca6a463ea9e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:18:36.548465 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:36.549095 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:36.550739 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1429/2832] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:18:36 2021] DELETE /identity/v3/projects/32584e7217c34b82a73aca6a463ea9e1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:36.555508 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bfa0b-adb2-49b2-8b1b-a63e72fd18ad service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:36.566410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bfa0b-adb2-49b2-8b1b-a63e72fd18ad service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:36.619593 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889ab89-04b2-4ea5-a918-0d2a6f19a6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:36.620441 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889ab89-04b2-4ea5-a918-0d2a6f19a6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:36.620722 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889ab89-04b2-4ea5-a918-0d2a6f19a6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:36.620996 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889ab89-04b2-4ea5-a918-0d2a6f19a6e9 admin admin] PATH_INFO: `/v3/users/df353dc3030840369a041228f005120c` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:36.622161 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889ab89-04b2-4ea5-a918-0d2a6f19a6e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df353dc3030840369a041228f005120c)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:36.624092 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889ab89-04b2-4ea5-a918-0d2a6f19a6e9 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:36.667249 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c889ab89-04b2-4ea5-a918-0d2a6f19a6e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df353dc3030840369a041228f005120c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:36.673645 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c889ab89-04b2-4ea5-a918-0d2a6f19a6e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df353dc3030840369a041228f005120c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:36.674280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c889ab89-04b2-4ea5-a918-0d2a6f19a6e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df353dc3030840369a041228f005120c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:36.674899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c889ab89-04b2-4ea5-a918-0d2a6f19a6e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df353dc3030840369a041228f005120c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:36.686941 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-c889ab89-04b2-4ea5-a918-0d2a6f19a6e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df353dc3030840369a041228f005120c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:36.701312 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1404/2833] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:18:36 2021] DELETE /identity/v3/users/df353dc3030840369a041228f005120c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:36.963244 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:36.964740 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:36.981120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cfaef-6028-4277-babc-d49cf4476136 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:37.042160 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785befa-ce56-4ddd-a1be-ae49c821ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:37.043049 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785befa-ce56-4ddd-a1be-ae49c821ecbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:37.043323 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785befa-ce56-4ddd-a1be-ae49c821ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:37.043598 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785befa-ce56-4ddd-a1be-ae49c821ecbd admin admin] PATH_INFO: `/v3/projects/231e64ef69284efd9f503c85b244ac20` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:37.044773 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785befa-ce56-4ddd-a1be-ae49c821ecbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=231e64ef69284efd9f503c85b244ac20)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:37.046714 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785befa-ce56-4ddd-a1be-ae49c821ecbd admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:37.093239 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e785befa-ce56-4ddd-a1be-ae49c821ecbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231e64ef69284efd9f503c85b244ac20', 'request_id': 'req-e785befa-ce56-4ddd-a1be-ae49c821ecbd'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:37.100059 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e785befa-ce56-4ddd-a1be-ae49c821ecbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231e64ef69284efd9f503c85b244ac20', 'request_id': 'req-e785befa-ce56-4ddd-a1be-ae49c821ecbd'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:37.106962 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e785befa-ce56-4ddd-a1be-ae49c821ecbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231e64ef69284efd9f503c85b244ac20', 'request_id': 'req-e785befa-ce56-4ddd-a1be-ae49c821ecbd'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:37.119715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e785befa-ce56-4ddd-a1be-ae49c821ecbd admin admin] The token cache is being invalidate because project 231e64ef69284efd9f503c85b244ac20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:18:37.120006 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e785befa-ce56-4ddd-a1be-ae49c821ecbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:37.120650 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-e785befa-ce56-4ddd-a1be-ae49c821ecbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:37.122180 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1430/2834] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:18:36 2021] DELETE /identity/v3/projects/231e64ef69284efd9f503c85b244ac20 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:18:37.128272 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37092f0d-25b7-4303-b063-63e19b03350e None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:37.128759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37092f0d-25b7-4303-b063-63e19b03350e None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:37.129230 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37092f0d-25b7-4303-b063-63e19b03350e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:37.147188 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-37092f0d-25b7-4303-b063-63e19b03350e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:37.148389 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-37092f0d-25b7-4303-b063-63e19b03350e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:37.208252 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1405/2835] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:37.216203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a8473-42aa-4801-b519-64f185cfb61e None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:37.216491 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a8473-42aa-4801-b519-64f185cfb61e None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:37.216765 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a8473-42aa-4801-b519-64f185cfb61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:37.234424 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-081a8473-42aa-4801-b519-64f185cfb61e None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:37.235641 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-081a8473-42aa-4801-b519-64f185cfb61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:37.243612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1431/2836] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:37.247757 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37092f0d-25b7-4303-b063-63e19b03350e None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:37.257978 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37092f0d-25b7-4303-b063-63e19b03350e None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:37.262713 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a945ff7-57ed-45b8-aaa1-bf86b6d96208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:37.263364 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945ff7-57ed-45b8-aaa1-bf86b6d96208 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:37.263672 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945ff7-57ed-45b8-aaa1-bf86b6d96208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:37.263947 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945ff7-57ed-45b8-aaa1-bf86b6d96208 admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:37.264680 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a945ff7-57ed-45b8-aaa1-bf86b6d96208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:18:37.264990 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a945ff7-57ed-45b8-aaa1-bf86b6d96208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:37.266615 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a945ff7-57ed-45b8-aaa1-bf86b6d96208 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:37.278681 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1406/2837] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:18:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:18:37.282974 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a8473-42aa-4801-b519-64f185cfb61e None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:37.292249 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a8473-42aa-4801-b519-64f185cfb61e None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:37.296935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e72a7-e736-4c18-b858-059cdf927187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:37.297573 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e72a7-e736-4c18-b858-059cdf927187 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:37.297857 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e72a7-e736-4c18-b858-059cdf927187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:37.298134 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e72a7-e736-4c18-b858-059cdf927187 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:37.298884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e72a7-e736-4c18-b858-059cdf927187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:37.300948 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e72a7-e736-4c18-b858-059cdf927187 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:37.325927 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1432/2838] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:18:37 2021] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:37.330128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a945ff7-57ed-45b8-aaa1-bf86b6d96208 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:37.342633 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a945ff7-57ed-45b8-aaa1-bf86b6d96208 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:37.400084 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985307a8-c67b-46a8-a4be-7820e4ec9f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:37.400759 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985307a8-c67b-46a8-a4be-7820e4ec9f1d admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:37.401123 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985307a8-c67b-46a8-a4be-7820e4ec9f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:37.401410 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985307a8-c67b-46a8-a4be-7820e4ec9f1d admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:37.402125 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985307a8-c67b-46a8-a4be-7820e4ec9f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:37.404087 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985307a8-c67b-46a8-a4be-7820e4ec9f1d admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:37.423437 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1407/2839] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:18:37 2021] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:37.427594 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e72a7-e736-4c18-b858-059cdf927187 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:37.437632 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e72a7-e736-4c18-b858-059cdf927187 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:37.442748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388c1e-9be8-4445-a954-a3abce78726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:37.443395 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388c1e-9be8-4445-a954-a3abce78726f admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:37.443679 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388c1e-9be8-4445-a954-a3abce78726f admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:37.443959 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388c1e-9be8-4445-a954-a3abce78726f admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:37.444690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388c1e-9be8-4445-a954-a3abce78726f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:37.446275 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388c1e-9be8-4445-a954-a3abce78726f admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:37.457508 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1433/2840] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:37 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:37.461178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985307a8-c67b-46a8-a4be-7820e4ec9f1d admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:37.470781 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985307a8-c67b-46a8-a4be-7820e4ec9f1d admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:37.475463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15588ed-385a-4737-9a3d-e6e84263e710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:37.476101 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15588ed-385a-4737-9a3d-e6e84263e710 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:37.476382 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15588ed-385a-4737-9a3d-e6e84263e710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:37.476658 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15588ed-385a-4737-9a3d-e6e84263e710 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:37.477383 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15588ed-385a-4737-9a3d-e6e84263e710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:37.479000 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15588ed-385a-4737-9a3d-e6e84263e710 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:37.488839 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1408/2841] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:37 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 09 01:18:37.492621 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388c1e-9be8-4445-a954-a3abce78726f admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:37.502546 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388c1e-9be8-4445-a954-a3abce78726f admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:37.507825 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca69e01-1d32-4048-a620-957d94625b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:37.508717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca69e01-1d32-4048-a620-957d94625b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:37.508994 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca69e01-1d32-4048-a620-957d94625b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:37.509263 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca69e01-1d32-4048-a620-957d94625b17 admin admin] PATH_INFO: `/v3/projects/bd7e582a091640249102ff2cfaacda45/users/a6c51f8fc49646059f165ffd0da8a41c/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:37.523826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca69e01-1d32-4048-a620-957d94625b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7e582a091640249102ff2cfaacda45, user_id=a6c51f8fc49646059f165ffd0da8a41c, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:37.526462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca69e01-1d32-4048-a620-957d94625b17 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:37.539268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1434/2842] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:37 2021] PUT /identity/v3/projects/bd7e582a091640249102ff2cfaacda45/users/a6c51f8fc49646059f165ffd0da8a41c/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:37.549226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b29ac7-8734-4613-b2c6-44b2d1ccd1cd None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:37.549513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b29ac7-8734-4613-b2c6-44b2d1ccd1cd None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:37.549790 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b29ac7-8734-4613-b2c6-44b2d1ccd1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:37.578664 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-b4b29ac7-8734-4613-b2c6-44b2d1ccd1cd None None] MFA Rules not processed for user `a6c51f8fc49646059f165ffd0da8a41c`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:37.579939 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-b4b29ac7-8734-4613-b2c6-44b2d1ccd1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:37.646268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1409/2843] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:37 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:37.656268 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca69e01-1d32-4048-a620-957d94625b17 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:37.657987 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0ca69e01-1d32-4048-a620-957d94625b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:37.716101 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca69e01-1d32-4048-a620-957d94625b17 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:37.719700 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99180d40-51cd-4314-90f6-9b80b56c717f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:37.720346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99180d40-51cd-4314-90f6-9b80b56c717f service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:37.720618 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99180d40-51cd-4314-90f6-9b80b56c717f service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:37.720893 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99180d40-51cd-4314-90f6-9b80b56c717f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:37.729179 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99180d40-51cd-4314-90f6-9b80b56c717f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:37.730658 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99180d40-51cd-4314-90f6-9b80b56c717f service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:37.739797 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1435/2844] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:37 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:18:40.655886 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b29ac7-8734-4613-b2c6-44b2d1ccd1cd None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:40.714889 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b29ac7-8734-4613-b2c6-44b2d1ccd1cd None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:40.719401 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:40.720270 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:40.720560 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:40.720838 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] PATH_INFO: `/v3/users/a6c51f8fc49646059f165ffd0da8a41c` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:40.722650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c51f8fc49646059f165ffd0da8a41c)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:40.724557 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:40.767989 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c51f8fc49646059f165ffd0da8a41c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:40.774976 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c51f8fc49646059f165ffd0da8a41c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:40.775628 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c51f8fc49646059f165ffd0da8a41c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:40.776226 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c51f8fc49646059f165ffd0da8a41c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:40.788146 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c51f8fc49646059f165ffd0da8a41c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:40.800263 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1410/2845] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:18:40 2021] DELETE /identity/v3/users/a6c51f8fc49646059f165ffd0da8a41c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:40.804927 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befe5f8-bb0b-456b-b88b-b6d1ed95ffa3 None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:40.805415 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befe5f8-bb0b-456b-b88b-b6d1ed95ffa3 None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:40.805528 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befe5f8-bb0b-456b-b88b-b6d1ed95ffa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:40.822869 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-3befe5f8-bb0b-456b-b88b-b6d1ed95ffa3 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:40.824064 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-3befe5f8-bb0b-456b-b88b-b6d1ed95ffa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:40.881526 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1436/2846] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:40.891341 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:40.892695 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:40.948818 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea67084-b5d5-4bf6-baee-a3874388fd49 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:40.952426 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee579fa-d9f1-4100-b3ba-52b0fff14c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:40.953058 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee579fa-d9f1-4100-b3ba-52b0fff14c75 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:40.953340 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee579fa-d9f1-4100-b3ba-52b0fff14c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:40.953619 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee579fa-d9f1-4100-b3ba-52b0fff14c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:40.963496 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee579fa-d9f1-4100-b3ba-52b0fff14c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:40.964918 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee579fa-d9f1-4100-b3ba-52b0fff14c75 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:40.974047 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1411/2847] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:41.230093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befe5f8-bb0b-456b-b88b-b6d1ed95ffa3 None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:41.231629 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-3befe5f8-bb0b-456b-b88b-b6d1ed95ffa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:41.244339 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befe5f8-bb0b-456b-b88b-b6d1ed95ffa3 None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:41.248882 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35497d-6559-43b0-b445-072c01984fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:41.249718 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35497d-6559-43b0-b445-072c01984fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:41.250003 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35497d-6559-43b0-b445-072c01984fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:41.250274 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35497d-6559-43b0-b445-072c01984fb8 admin admin] PATH_INFO: `/v3/projects/bd7e582a091640249102ff2cfaacda45` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:41.251484 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35497d-6559-43b0-b445-072c01984fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7e582a091640249102ff2cfaacda45)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:41.254452 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35497d-6559-43b0-b445-072c01984fb8 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:41.301447 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bf35497d-6559-43b0-b445-072c01984fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7e582a091640249102ff2cfaacda45', 'request_id': 'req-bf35497d-6559-43b0-b445-072c01984fb8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:41.307568 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bf35497d-6559-43b0-b445-072c01984fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7e582a091640249102ff2cfaacda45', 'request_id': 'req-bf35497d-6559-43b0-b445-072c01984fb8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:41.314888 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bf35497d-6559-43b0-b445-072c01984fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7e582a091640249102ff2cfaacda45', 'request_id': 'req-bf35497d-6559-43b0-b445-072c01984fb8'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:41.325492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bf35497d-6559-43b0-b445-072c01984fb8 admin admin] The token cache is being invalidate because project bd7e582a091640249102ff2cfaacda45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:18:41.325780 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bf35497d-6559-43b0-b445-072c01984fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:41.326425 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-bf35497d-6559-43b0-b445-072c01984fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:41.327938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1437/2848] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:18:41 2021] DELETE /identity/v3/projects/bd7e582a091640249102ff2cfaacda45 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:41.334085 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956a0c6-4274-478d-a00d-06e31723c271 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:41.334392 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956a0c6-4274-478d-a00d-06e31723c271 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:41.334674 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956a0c6-4274-478d-a00d-06e31723c271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:41.351661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-3956a0c6-4274-478d-a00d-06e31723c271 None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:41.352957 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-3956a0c6-4274-478d-a00d-06e31723c271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:41.409803 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1412/2849] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 09 01:18:41.418717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa451e-bbbf-4b95-a87f-90613c80a3bd None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:41.419001 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa451e-bbbf-4b95-a87f-90613c80a3bd None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:41.419301 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa451e-bbbf-4b95-a87f-90613c80a3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:41.437705 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-33aa451e-bbbf-4b95-a87f-90613c80a3bd None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:41.438938 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-33aa451e-bbbf-4b95-a87f-90613c80a3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:41.447318 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1438/2850] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:41.451490 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956a0c6-4274-478d-a00d-06e31723c271 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:41.461832 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956a0c6-4274-478d-a00d-06e31723c271 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:41.466395 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4678e-9428-4bc4-80bc-5ae7b06bc7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:41.467046 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4678e-9428-4bc4-80bc-5ae7b06bc7ee admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:41.467327 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4678e-9428-4bc4-80bc-5ae7b06bc7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:41.467601 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4678e-9428-4bc4-80bc-5ae7b06bc7ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:41.468325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4678e-9428-4bc4-80bc-5ae7b06bc7ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 09 01:18:41.468629 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4678e-9428-4bc4-80bc-5ae7b06bc7ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:41.470199 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4678e-9428-4bc4-80bc-5ae7b06bc7ee admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:41.481403 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1413/2851] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Dec 9 01:18:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 09 01:18:41.485578 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa451e-bbbf-4b95-a87f-90613c80a3bd None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:41.495093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa451e-bbbf-4b95-a87f-90613c80a3bd None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:41.499728 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb7252-d2ae-4c04-8bf7-7b6aa35b7f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:41.500362 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb7252-d2ae-4c04-8bf7-7b6aa35b7f04 admin admin] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:41.500644 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb7252-d2ae-4c04-8bf7-7b6aa35b7f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:41.500918 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb7252-d2ae-4c04-8bf7-7b6aa35b7f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:41.501602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb7252-d2ae-4c04-8bf7-7b6aa35b7f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:41.504231 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb7252-d2ae-4c04-8bf7-7b6aa35b7f04 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:41.528555 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1439/2852] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Dec 9 01:18:41 2021] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:41.532597 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4678e-9428-4bc4-80bc-5ae7b06bc7ee admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:41.542342 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4678e-9428-4bc4-80bc-5ae7b06bc7ee admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:41.597026 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b5d59-f236-4fde-99ea-b82e2821a410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:41.597860 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b5d59-f236-4fde-99ea-b82e2821a410 admin admin] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:41.598109 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b5d59-f236-4fde-99ea-b82e2821a410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:41.598463 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b5d59-f236-4fde-99ea-b82e2821a410 admin admin] PATH_INFO: `/v3/users` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:41.599263 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b5d59-f236-4fde-99ea-b82e2821a410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:41.601157 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b5d59-f236-4fde-99ea-b82e2821a410 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:41.619828 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1414/2853] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Dec 9 01:18:41 2021] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 09 01:18:41.623844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb7252-d2ae-4c04-8bf7-7b6aa35b7f04 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:41.634565 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb7252-d2ae-4c04-8bf7-7b6aa35b7f04 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:41.639115 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e79a8-75ed-4f8e-82dc-ff502f1b73b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:41.639755 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e79a8-75ed-4f8e-82dc-ff502f1b73b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:41.640034 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e79a8-75ed-4f8e-82dc-ff502f1b73b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:41.640305 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e79a8-75ed-4f8e-82dc-ff502f1b73b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:41.641028 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e79a8-75ed-4f8e-82dc-ff502f1b73b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:41.642634 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e79a8-75ed-4f8e-82dc-ff502f1b73b7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:41.652869 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1440/2854] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:41.656550 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b5d59-f236-4fde-99ea-b82e2821a410 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:41.667383 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b5d59-f236-4fde-99ea-b82e2821a410 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:41.671877 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648da9f-3c8c-43fb-99cc-f8b875873aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:41.672518 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648da9f-3c8c-43fb-99cc-f8b875873aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:41.672817 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648da9f-3c8c-43fb-99cc-f8b875873aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:41.673076 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648da9f-3c8c-43fb-99cc-f8b875873aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:41.673801 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648da9f-3c8c-43fb-99cc-f8b875873aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:41.676408 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648da9f-3c8c-43fb-99cc-f8b875873aa0 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:41.685911 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1415/2855] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Dec 9 01:18:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 09 01:18:41.689844 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e79a8-75ed-4f8e-82dc-ff502f1b73b7 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:41.699829 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e79a8-75ed-4f8e-82dc-ff502f1b73b7 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:41.704382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eee0b-c421-43d2-82f2-836bc13b5868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:41.705238 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eee0b-c421-43d2-82f2-836bc13b5868 admin admin] REQUEST_METHOD: `PUT` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:41.705513 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eee0b-c421-43d2-82f2-836bc13b5868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:41.705808 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eee0b-c421-43d2-82f2-836bc13b5868 admin admin] PATH_INFO: `/v3/projects/8569e410f76e4bd79a314eec07b541ba/users/c3c23935e7984c2b998737e018a386da/roles/800b8a36452a418b82e9e25cef933520` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:41.720382 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902eee0b-c421-43d2-82f2-836bc13b5868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8569e410f76e4bd79a314eec07b541ba, user_id=c3c23935e7984c2b998737e018a386da, role_id=800b8a36452a418b82e9e25cef933520)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:41.723690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902eee0b-c421-43d2-82f2-836bc13b5868 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:41.735738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1441/2856] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Dec 9 01:18:41 2021] PUT /identity/v3/projects/8569e410f76e4bd79a314eec07b541ba/users/c3c23935e7984c2b998737e018a386da/roles/800b8a36452a418b82e9e25cef933520 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:41.747107 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f378cfa-f901-4f47-90c2-976c8fcf3bd0 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:41.747398 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f378cfa-f901-4f47-90c2-976c8fcf3bd0 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:41.747675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f378cfa-f901-4f47-90c2-976c8fcf3bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:41.774222 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-0f378cfa-f901-4f47-90c2-976c8fcf3bd0 None None] MFA Rules not processed for user `c3c23935e7984c2b998737e018a386da`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:41.775477 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0f378cfa-f901-4f47-90c2-976c8fcf3bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:41.838513 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1416/2857] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:41 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:41.849730 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eee0b-c421-43d2-82f2-836bc13b5868 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:41.851514 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-902eee0b-c421-43d2-82f2-836bc13b5868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:41.906941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eee0b-c421-43d2-82f2-836bc13b5868 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:41.911152 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d98723-6c2a-4e04-8dec-3d187cf99ffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5625c813724729bb927c201f23e417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:41.911782 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98723-6c2a-4e04-8dec-3d187cf99ffa service cinder] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:41.912080 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98723-6c2a-4e04-8dec-3d187cf99ffa service cinder] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:41.912337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98723-6c2a-4e04-8dec-3d187cf99ffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:41.920580 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d98723-6c2a-4e04-8dec-3d187cf99ffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:41.921945 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d98723-6c2a-4e04-8dec-3d187cf99ffa service cinder] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:41.931154 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1442/2858] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:41 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:41.955567 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f378cfa-f901-4f47-90c2-976c8fcf3bd0 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:42.015388 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f378cfa-f901-4f47-90c2-976c8fcf3bd0 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:42.020480 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:42.021323 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:42.021597 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:42.021865 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] PATH_INFO: `/v3/users/c3c23935e7984c2b998737e018a386da` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:42.023057 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c23935e7984c2b998737e018a386da)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:42.024959 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:42.070447 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c23935e7984c2b998737e018a386da'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:42.077180 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c23935e7984c2b998737e018a386da'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:42.077859 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c23935e7984c2b998737e018a386da'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:42.078522 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c23935e7984c2b998737e018a386da'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:42.090806 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c23935e7984c2b998737e018a386da'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:42.105108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1417/2859] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:18:41 2021] DELETE /identity/v3/users/c3c23935e7984c2b998737e018a386da => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:42.109676 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f543c-07e5-4e8c-b4ee-9f22be12d68d None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:42.109963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f543c-07e5-4e8c-b4ee-9f22be12d68d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:42.110243 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f543c-07e5-4e8c-b4ee-9f22be12d68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:42.127331 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-fc8f543c-07e5-4e8c-b4ee-9f22be12d68d None None] MFA Rules not processed for user `9a491d369dd94708903d971f130743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:42.129225 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fc8f543c-07e5-4e8c-b4ee-9f22be12d68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:42.184039 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1443/2860] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:18:42.194572 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:42.196391 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:42.250988 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d53c3a-7236-4716-8f78-ed3d48ffcebb admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:42.255256 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe60e48-4b49-4e64-b3ba-d8abba1f429a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:42.255890 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe60e48-4b49-4e64-b3ba-d8abba1f429a service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:42.256170 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe60e48-4b49-4e64-b3ba-d8abba1f429a service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:42.256448 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe60e48-4b49-4e64-b3ba-d8abba1f429a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:42.265229 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe60e48-4b49-4e64-b3ba-d8abba1f429a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:42.266675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe60e48-4b49-4e64-b3ba-d8abba1f429a service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:42.276232 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1418/2861] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:18:42.538336 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f543c-07e5-4e8c-b4ee-9f22be12d68d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:42.539503 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fc8f543c-07e5-4e8c-b4ee-9f22be12d68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:42.552290 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f543c-07e5-4e8c-b4ee-9f22be12d68d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:42.556947 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:42.558052 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:42.558346 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:42.558685 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] PATH_INFO: `/v3/projects/8569e410f76e4bd79a314eec07b541ba` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:42.560111 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8569e410f76e4bd79a314eec07b541ba)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:42.562343 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:42.610038 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8569e410f76e4bd79a314eec07b541ba', 'request_id': 'req-0de67224-7b73-434c-ad49-56ea3dde9740'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:42.616806 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8569e410f76e4bd79a314eec07b541ba', 'request_id': 'req-0de67224-7b73-434c-ad49-56ea3dde9740'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:42.624145 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8569e410f76e4bd79a314eec07b541ba', 'request_id': 'req-0de67224-7b73-434c-ad49-56ea3dde9740'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:42.634258 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] The token cache is being invalidate because project 8569e410f76e4bd79a314eec07b541ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:18:42.634602 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:42.635226 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:18:42.636738 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1444/2862] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:18:42 2021] DELETE /identity/v3/projects/8569e410f76e4bd79a314eec07b541ba => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:18:52.162325 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe60e48-4b49-4e64-b3ba-d8abba1f429a service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:52.170858 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe60e48-4b49-4e64-b3ba-d8abba1f429a service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:52.221280 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fd9e2-7086-4c1f-8f42-0a6bde102678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:52.222062 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fd9e2-7086-4c1f-8f42-0a6bde102678 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:52.222453 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fd9e2-7086-4c1f-8f42-0a6bde102678 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:52.222721 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fd9e2-7086-4c1f-8f42-0a6bde102678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:52.224561 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f47fd9e2-7086-4c1f-8f42-0a6bde102678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:52.294098 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fd9e2-7086-4c1f-8f42-0a6bde102678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:52.295567 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fd9e2-7086-4c1f-8f42-0a6bde102678 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:52.307155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1419/2863] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:52 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:53.502399 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:18:53.503939 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:53.516200 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67224-7b73-434c-ad49-56ea3dde9740 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:18:53.520709 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fa4d1-2a26-4ee2-814c-ed93ab00a3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:18:53.521459 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fa4d1-2a26-4ee2-814c-ed93ab00a3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:53.521748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fa4d1-2a26-4ee2-814c-ed93ab00a3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:53.522023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fa4d1-2a26-4ee2-814c-ed93ab00a3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:53.523805 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e81fa4d1-2a26-4ee2-814c-ed93ab00a3f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:53.537745 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fa4d1-2a26-4ee2-814c-ed93ab00a3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:18:53.539203 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fa4d1-2a26-4ee2-814c-ed93ab00a3f0 service neutron] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:18:53.549885 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1445/2864] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:18:53 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:18:56.955831 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627ea4b-8c70-4ebc-a97a-2eab5ba07866 None None] REQUEST_METHOD: `POST` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:18:56.956329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627ea4b-8c70-4ebc-a97a-2eab5ba07866 None None] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:18:56.956464 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627ea4b-8c70-4ebc-a97a-2eab5ba07866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:18:56.973864 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.auth.core [None req-5627ea4b-8c70-4ebc-a97a-2eab5ba07866 None None] MFA Rules not processed for user `145783b498ca431aab3f9fe0c958e60a`. Rule list: `[]` (Enabled: `True`). {{(pid=79330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:18:56.975178 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-5627ea4b-8c70-4ebc-a97a-2eab5ba07866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:18:57.029328 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1420/2865] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:18:56 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:19:03.562421 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fa4d1-2a26-4ee2-814c-ed93ab00a3f0 service neutron] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:19:03.564146 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-e81fa4d1-2a26-4ee2-814c-ed93ab00a3f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:19:03.630933 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fa4d1-2a26-4ee2-814c-ed93ab00a3f0 service neutron] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:19:03.635441 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:19:03.636291 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:19:03.636571 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:19:03.636846 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] PATH_INFO: `/v3/users/eb1a5b2feb8e4f93a4eeb90de9adb927` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:19:03.638084 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1a5b2feb8e4f93a4eeb90de9adb927)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:19:03.640097 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:19:03.683216 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1a5b2feb8e4f93a4eeb90de9adb927'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:03.683787 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1a5b2feb8e4f93a4eeb90de9adb927'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:03.690164 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1a5b2feb8e4f93a4eeb90de9adb927'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:03.691315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1a5b2feb8e4f93a4eeb90de9adb927'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:03.702234 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1a5b2feb8e4f93a4eeb90de9adb927'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:03.714956 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1446/2866] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:19:03 2021] DELETE /identity/v3/users/eb1a5b2feb8e4f93a4eeb90de9adb927 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:19:03.889679 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627ea4b-8c70-4ebc-a97a-2eab5ba07866 None None] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:19:03.907944 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627ea4b-8c70-4ebc-a97a-2eab5ba07866 None None] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:19:03.968032 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:19:03.968887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:19:03.969172 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:19:03.969449 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] PATH_INFO: `/v3/projects/b9af91ce42164b7d8dbeecc27f4698e8` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:19:03.970697 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9af91ce42164b7d8dbeecc27f4698e8)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:19:03.972802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:19:04.018385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9af91ce42164b7d8dbeecc27f4698e8', 'request_id': 'req-3c651aed-a869-4e22-b41a-a9027446e40c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.023589 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9af91ce42164b7d8dbeecc27f4698e8', 'request_id': 'req-3c651aed-a869-4e22-b41a-a9027446e40c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.029470 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9af91ce42164b7d8dbeecc27f4698e8', 'request_id': 'req-3c651aed-a869-4e22-b41a-a9027446e40c'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.040824 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] The token cache is being invalidate because project b9af91ce42164b7d8dbeecc27f4698e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:19:04.041108 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.041717 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.043267 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1421/2867] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:19:03 2021] DELETE /identity/v3/projects/b9af91ce42164b7d8dbeecc27f4698e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:19:04.047279 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:19:04.048704 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:19:04.062150 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b2775-b98d-4a93-b4fa-aa5041e2415a admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:19:04.118527 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:19:04.119381 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:19:04.119663 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:19:04.119934 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] PATH_INFO: `/v3/users/64fe7e33da074880890ff49ec6ee4c16` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:19:04.121110 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64fe7e33da074880890ff49ec6ee4c16)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:19:04.123041 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:19:04.166776 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64fe7e33da074880890ff49ec6ee4c16'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.167412 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64fe7e33da074880890ff49ec6ee4c16'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.173860 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64fe7e33da074880890ff49ec6ee4c16'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.174501 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64fe7e33da074880890ff49ec6ee4c16'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.186791 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64fe7e33da074880890ff49ec6ee4c16'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.199237 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1447/2868] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:19:04 2021] DELETE /identity/v3/users/64fe7e33da074880890ff49ec6ee4c16 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:19:04.210219 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:19:04.211625 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:19:04.267268 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c651aed-a869-4e22-b41a-a9027446e40c admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:19:04.312469 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d6b3c-6ff2-4038-a539-b1625a4aff31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:19:04.313111 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d6b3c-6ff2-4038-a539-b1625a4aff31 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:19:04.313399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d6b3c-6ff2-4038-a539-b1625a4aff31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:19:04.313676 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d6b3c-6ff2-4038-a539-b1625a4aff31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:19:04.315965 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-df2d6b3c-6ff2-4038-a539-b1625a4aff31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:19:04.375427 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d6b3c-6ff2-4038-a539-b1625a4aff31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:19:04.376845 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d6b3c-6ff2-4038-a539-b1625a4aff31 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:19:04.387072 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1422/2869] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:19:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:19:04.558335 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:19:04.559984 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:19:04.574549 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901c8d2-1b75-449d-9c8c-c8cb6cdd07c5 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:19:04.579435 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a036bf-94db-4f39-b1f4-44234b4c9eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:19:04.580321 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a036bf-94db-4f39-b1f4-44234b4c9eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:19:04.580599 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a036bf-94db-4f39-b1f4-44234b4c9eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:19:04.582436 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a036bf-94db-4f39-b1f4-44234b4c9eb7 admin admin] PATH_INFO: `/v3/projects/c15cf460119f4743a9072d2d20a31f4a` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:19:04.583790 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a036bf-94db-4f39-b1f4-44234b4c9eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15cf460119f4743a9072d2d20a31f4a)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:19:04.585941 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a036bf-94db-4f39-b1f4-44234b4c9eb7 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:19:04.630756 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-31a036bf-94db-4f39-b1f4-44234b4c9eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15cf460119f4743a9072d2d20a31f4a', 'request_id': 'req-31a036bf-94db-4f39-b1f4-44234b4c9eb7'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.636537 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-31a036bf-94db-4f39-b1f4-44234b4c9eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15cf460119f4743a9072d2d20a31f4a', 'request_id': 'req-31a036bf-94db-4f39-b1f4-44234b4c9eb7'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.642917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-31a036bf-94db-4f39-b1f4-44234b4c9eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15cf460119f4743a9072d2d20a31f4a', 'request_id': 'req-31a036bf-94db-4f39-b1f4-44234b4c9eb7'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.653646 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-31a036bf-94db-4f39-b1f4-44234b4c9eb7 admin admin] The token cache is being invalidate because project c15cf460119f4743a9072d2d20a31f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:19:04.653935 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-31a036bf-94db-4f39-b1f4-44234b4c9eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.654609 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-31a036bf-94db-4f39-b1f4-44234b4c9eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:19:04.656134 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1448/2870] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:19:04 2021] DELETE /identity/v3/projects/c15cf460119f4743a9072d2d20a31f4a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:19:15.196012 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d6b3c-6ff2-4038-a539-b1625a4aff31 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:19:15.197525 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-df2d6b3c-6ff2-4038-a539-b1625a4aff31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:19:15.208937 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d6b3c-6ff2-4038-a539-b1625a4aff31 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:19:15.257208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f8396-0be8-45bd-b6c8-a2c1357bac7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:19:15.257853 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f8396-0be8-45bd-b6c8-a2c1357bac7e service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:19:15.258128 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f8396-0be8-45bd-b6c8-a2c1357bac7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:19:15.258429 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f8396-0be8-45bd-b6c8-a2c1357bac7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:19:15.260252 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-db1f8396-0be8-45bd-b6c8-a2c1357bac7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:19:15.269650 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f8396-0be8-45bd-b6c8-a2c1357bac7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:19:15.271102 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f8396-0be8-45bd-b6c8-a2c1357bac7e service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:19:15.279086 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1423/2871] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:19:15 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:20:54.382658 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f0ad9-a65e-4a08-bd67-0b62e68be89d None None] REQUEST_METHOD: `POST` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:20:54.383176 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f0ad9-a65e-4a08-bd67-0b62e68be89d None None] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:20:54.383295 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f0ad9-a65e-4a08-bd67-0b62e68be89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:20:54.400492 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.auth.core [None req-192f0ad9-a65e-4a08-bd67-0b62e68be89d None None] MFA Rules not processed for user `145783b498ca431aab3f9fe0c958e60a`. Rule list: `[]` (Enabled: `True`). {{(pid=79331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 09 01:20:54.401691 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-192f0ad9-a65e-4a08-bd67-0b62e68be89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:20:54.453144 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1449/2872] 10.222.0.23 () {58 vars in 957 bytes} [Thu Dec 9 01:20:54 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 09 01:20:55.004274 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f8396-0be8-45bd-b6c8-a2c1357bac7e service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:20:55.005675 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-db1f8396-0be8-45bd-b6c8-a2c1357bac7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:20:55.018412 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f8396-0be8-45bd-b6c8-a2c1357bac7e service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:20:55.022081 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facfbc8-3d18-46b3-a246-6a033611e3d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:20:55.022741 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facfbc8-3d18-46b3-a246-6a033611e3d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:20:55.023075 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facfbc8-3d18-46b3-a246-6a033611e3d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:20:55.023303 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facfbc8-3d18-46b3-a246-6a033611e3d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:20:55.025051 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0facfbc8-3d18-46b3-a246-6a033611e3d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:20:55.035155 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facfbc8-3d18-46b3-a246-6a033611e3d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:20:55.036571 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facfbc8-3d18-46b3-a246-6a033611e3d1 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:20:55.044577 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1424/2873] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:20:55 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:20:55.478073 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f0ad9-a65e-4a08-bd67-0b62e68be89d None None] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:20:55.479717 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-192f0ad9-a65e-4a08-bd67-0b62e68be89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:20:55.550966 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f0ad9-a65e-4a08-bd67-0b62e68be89d None None] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:20:55.555748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f337d71-1ff4-41af-8833-c913948b967b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cebb33ff7c4e40a06b3c7f1a40823d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:20:55.556378 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337d71-1ff4-41af-8833-c913948b967b service placement] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:20:55.556657 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337d71-1ff4-41af-8833-c913948b967b service placement] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:20:55.556928 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337d71-1ff4-41af-8833-c913948b967b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:20:55.559204 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5f337d71-1ff4-41af-8833-c913948b967b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:20:55.570143 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337d71-1ff4-41af-8833-c913948b967b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:20:55.571748 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337d71-1ff4-41af-8833-c913948b967b service placement] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:20:55.583017 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1450/2874] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:20:55 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:20:57.972374 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facfbc8-3d18-46b3-a246-6a033611e3d1 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:20:57.974611 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-0facfbc8-3d18-46b3-a246-6a033611e3d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:20:58.064592 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facfbc8-3d18-46b3-a246-6a033611e3d1 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:20:58.070348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a434a-e47f-4ce0-8301-ac9070743eaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:20:58.071036 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a434a-e47f-4ce0-8301-ac9070743eaf service nova] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:20:58.072117 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a434a-e47f-4ce0-8301-ac9070743eaf service nova] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:20:58.072399 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a434a-e47f-4ce0-8301-ac9070743eaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:20:58.075385 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f99a434a-e47f-4ce0-8301-ac9070743eaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:20:58.089094 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a434a-e47f-4ce0-8301-ac9070743eaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:20:58.090769 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a434a-e47f-4ce0-8301-ac9070743eaf service nova] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:20:58.102338 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1425/2875] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:20:57 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 09 01:21:08.059668 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f337d71-1ff4-41af-8833-c913948b967b service placement] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:21:08.061212 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-5f337d71-1ff4-41af-8833-c913948b967b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:21:08.079262 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f337d71-1ff4-41af-8833-c913948b967b service placement] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:21:08.084698 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b2b6c-978a-4544-94b5-c983369d8385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d32ba063bc4a719d4c2f67d88ec640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:21:08.085337 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b2b6c-978a-4544-94b5-c983369d8385 service nova] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:21:08.085621 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b2b6c-978a-4544-94b5-c983369d8385 service nova] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:21:08.085899 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b2b6c-978a-4544-94b5-c983369d8385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:21:08.087690 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-6d8b2b6c-978a-4544-94b5-c983369d8385 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:21:08.100093 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b2b6c-978a-4544-94b5-c983369d8385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:21:08.101612 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b2b6c-978a-4544-94b5-c983369d8385 service nova] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:21:08.113023 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1451/2876] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:21:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:22:39.300384 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a434a-e47f-4ce0-8301-ac9070743eaf service nova] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:22:39.301780 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-f99a434a-e47f-4ce0-8301-ac9070743eaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:22:39.363613 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a434a-e47f-4ce0-8301-ac9070743eaf service nova] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:22:39.367269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff2808-f7b7-4402-a735-d5f4718abf44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:22:39.367899 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff2808-f7b7-4402-a735-d5f4718abf44 service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:22:39.368182 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff2808-f7b7-4402-a735-d5f4718abf44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:22:39.368458 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff2808-f7b7-4402-a735-d5f4718abf44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:22:39.370184 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-e5ff2808-f7b7-4402-a735-d5f4718abf44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:22:39.394536 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff2808-f7b7-4402-a735-d5f4718abf44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:22:39.395982 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff2808-f7b7-4402-a735-d5f4718abf44 service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:22:39.405495 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1426/2877] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:22:39 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:22:43.316392 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b2b6c-978a-4544-94b5-c983369d8385 service nova] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:22:43.374398 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b2b6c-978a-4544-94b5-c983369d8385 service nova] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:22:43.379320 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c2017-a6e7-40a0-922d-1e3210baf79f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cebb33ff7c4e40a06b3c7f1a40823d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:22:43.379951 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c2017-a6e7-40a0-922d-1e3210baf79f service placement] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:22:43.380230 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c2017-a6e7-40a0-922d-1e3210baf79f service placement] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:22:43.380498 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c2017-a6e7-40a0-922d-1e3210baf79f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:22:43.382246 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a30c2017-a6e7-40a0-922d-1e3210baf79f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:22:43.405757 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c2017-a6e7-40a0-922d-1e3210baf79f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:22:43.407348 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c2017-a6e7-40a0-922d-1e3210baf79f service placement] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:22:43.416884 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1452/2878] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:22:43 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:22:52.545133 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff2808-f7b7-4402-a735-d5f4718abf44 service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:22:52.553921 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff2808-f7b7-4402-a735-d5f4718abf44 service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:22:52.557554 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4252f47-6b6f-47b3-a22f-d27ed75cf2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73b6f3a1949359549f91e1b708600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:22:52.558195 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4252f47-6b6f-47b3-a22f-d27ed75cf2dc service neutron] REQUEST_METHOD: `GET` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:22:52.558521 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4252f47-6b6f-47b3-a22f-d27ed75cf2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:22:52.558802 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4252f47-6b6f-47b3-a22f-d27ed75cf2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:22:52.561295 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-d4252f47-6b6f-47b3-a22f-d27ed75cf2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:22:52.643887 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4252f47-6b6f-47b3-a22f-d27ed75cf2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:22:52.645335 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4252f47-6b6f-47b3-a22f-d27ed75cf2dc service neutron] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:22:52.663420 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1427/2879] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:22:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 09 01:22:59.012169 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c2017-a6e7-40a0-922d-1e3210baf79f service placement] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:22:59.014826 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-a30c2017-a6e7-40a0-922d-1e3210baf79f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:22:59.030480 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c2017-a6e7-40a0-922d-1e3210baf79f service placement] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:22:59.035715 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:22:59.036800 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:22:59.037035 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:22:59.037317 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] PATH_INFO: `/v3/users/145783b498ca431aab3f9fe0c958e60a` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:22:59.038624 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=145783b498ca431aab3f9fe0c958e60a)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:22:59.040610 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:22:59.104254 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145783b498ca431aab3f9fe0c958e60a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.104931 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145783b498ca431aab3f9fe0c958e60a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.114637 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145783b498ca431aab3f9fe0c958e60a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.115388 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145783b498ca431aab3f9fe0c958e60a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.133754 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145783b498ca431aab3f9fe0c958e60a'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.158849 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1453/2880] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:22:59 2021] DELETE /identity/v3/users/145783b498ca431aab3f9fe0c958e60a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:22:59.330771 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4252f47-6b6f-47b3-a22f-d27ed75cf2dc service neutron] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:22:59.342995 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4252f47-6b6f-47b3-a22f-d27ed75cf2dc service neutron] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:22:59.399153 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:22:59.399929 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:22:59.400208 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:22:59.400478 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] PATH_INFO: `/v3/projects/7480e21bc2664d4e94526980995f0f6c` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:22:59.401634 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7480e21bc2664d4e94526980995f0f6c)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:22:59.403971 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:22:59.448511 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7480e21bc2664d4e94526980995f0f6c', 'request_id': 'req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.454348 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7480e21bc2664d4e94526980995f0f6c', 'request_id': 'req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.460245 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7480e21bc2664d4e94526980995f0f6c', 'request_id': 'req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.471883 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] The token cache is being invalidate because project 7480e21bc2664d4e94526980995f0f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:22:59.472166 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.472776 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.474269 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1428/2881] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:22:59 2021] DELETE /identity/v3/projects/7480e21bc2664d4e94526980995f0f6c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:22:59.478315 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:22:59.479729 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:22:59.492232 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59392e5d-780d-4ad1-9900-60442ca54ec0 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:22:59.546963 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:22:59.547816 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:22:59.548094 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:22:59.548365 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] PATH_INFO: `/v3/users/7d43084ca280496b94559ddc3bb2cf27` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:22:59.549556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d43084ca280496b94559ddc3bb2cf27)` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:22:59.551571 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:22:59.594814 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d43084ca280496b94559ddc3bb2cf27'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.595377 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d43084ca280496b94559ddc3bb2cf27'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.601810 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d43084ca280496b94559ddc3bb2cf27'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.602453 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d43084ca280496b94559ddc3bb2cf27'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.613937 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.notifications [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d43084ca280496b94559ddc3bb2cf27'} {{(pid=79331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.626684 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1454/2882] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Dec 9 01:22:59 2021] DELETE /identity/v3/users/7d43084ca280496b94559ddc3bb2cf27 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 09 01:22:59.797661 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] Authenticating user token {{(pid=79330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:22:59.799149 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.fernet_utils [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:22:59.813928 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb0e75-b503-431c-a6d8-58bcc52c7b34 admin admin] Validating token access rules against request {{(pid=79330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:22:59.870341 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7cca5-c096-4e75-9ff8-3ce764fe9648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a491d369dd94708903d971f130743aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e540339684142b1a25d3f47e2a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:22:59.871227 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7cca5-c096-4e75-9ff8-3ce764fe9648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:22:59.871510 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7cca5-c096-4e75-9ff8-3ce764fe9648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:22:59.871787 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7cca5-c096-4e75-9ff8-3ce764fe9648 admin admin] PATH_INFO: `/v3/projects/d31e005e5dc549e5b246863e835dcdc5` {{(pid=79330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:22:59.873591 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7cca5-c096-4e75-9ff8-3ce764fe9648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31e005e5dc549e5b246863e835dcdc5)` {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:22:59.875504 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7cca5-c096-4e75-9ff8-3ce764fe9648 admin admin] RBAC: Authorization granted {{(pid=79330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:22:59.921329 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-75c7cca5-c096-4e75-9ff8-3ce764fe9648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31e005e5dc549e5b246863e835dcdc5', 'request_id': 'req-75c7cca5-c096-4e75-9ff8-3ce764fe9648'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.926744 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-75c7cca5-c096-4e75-9ff8-3ce764fe9648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31e005e5dc549e5b246863e835dcdc5', 'request_id': 'req-75c7cca5-c096-4e75-9ff8-3ce764fe9648'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.932754 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-75c7cca5-c096-4e75-9ff8-3ce764fe9648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31e005e5dc549e5b246863e835dcdc5', 'request_id': 'req-75c7cca5-c096-4e75-9ff8-3ce764fe9648'} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.945438 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-75c7cca5-c096-4e75-9ff8-3ce764fe9648 admin admin] The token cache is being invalidate because project d31e005e5dc549e5b246863e835dcdc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 09 01:22:59.945727 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-75c7cca5-c096-4e75-9ff8-3ce764fe9648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.946349 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: DEBUG keystone.notifications [None req-75c7cca5-c096-4e75-9ff8-3ce764fe9648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 09 01:22:59.947891 dv-cinder-790535-20-iscsi devstack@keystone.service[79330]: [pid: 79330|app: 0|req: 1429/2883] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Dec 9 01:22:59 2021] DELETE /identity/v3/projects/d31e005e5dc549e5b246863e835dcdc5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 09 01:28:08.239556 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] Authenticating user token {{(pid=79331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 09 01:28:08.240930 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:28:08.305917 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a07e9e-ffa1-4ca7-acf3-8ce0d13e2a32 admin admin] Validating token access rules against request {{(pid=79331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 09 01:28:08.367540 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65926b3e-4a42-4432-ac20-583b7259b876 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cebb33ff7c4e40a06b3c7f1a40823d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0566d367619740a48d8dca2def78a386', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 09 01:28:08.368177 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65926b3e-4a42-4432-ac20-583b7259b876 service placement] REQUEST_METHOD: `GET` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 09 01:28:08.368458 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65926b3e-4a42-4432-ac20-583b7259b876 service placement] SCRIPT_NAME: `/identity` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 09 01:28:08.368731 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65926b3e-4a42-4432-ac20-583b7259b876 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 09 01:28:08.371120 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.fernet_utils [None req-65926b3e-4a42-4432-ac20-583b7259b876 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 09 01:28:08.381809 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65926b3e-4a42-4432-ac20-583b7259b876 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 09 01:28:08.383462 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65926b3e-4a42-4432-ac20-583b7259b876 service placement] RBAC: Authorization granted {{(pid=79331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 09 01:28:08.393563 dv-cinder-790535-20-iscsi devstack@keystone.service[79331]: [pid: 79331|app: 0|req: 1455/2884] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Dec 9 01:28:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)